[ 559.987118] env[66067]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 559.987118] env[66067]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 560.989781] env[66157]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 560.989781] env[66157]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 562.553550] env[66157]: INFO neutron.common.config [-] Logging enabled! [ 562.553907] env[66157]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.1.0.dev44 [ 562.554103] env[66157]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66157) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 562.554435] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 562.554533] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 562.555360] env[66157]: WARNING oslo_policy.policy [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 562.555582] env[66157]: WARNING oslo_policy.policy [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 562.557247] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] VMware NSXv3 Agent initialized successfully. [ 562.557597] env[66157]: DEBUG oslo_concurrency.lockutils [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] Acquiring lock "singleton_lock" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.557724] env[66157]: DEBUG oslo_concurrency.lockutils [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] Acquired lock "singleton_lock" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.557926] env[66157]: DEBUG oslo_concurrency.lockutils [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] Releasing lock "singleton_lock" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.558221] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] Full set of CONF: {{(pid=66157) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 562.558335] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ******************************************************************************** {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 562.558434] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] Configuration options gathered from: {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 562.558773] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 562.558938] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 562.559051] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ================================================================================ {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 562.559217] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] agent_down_time = 75 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.559352] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] allow_automatic_dhcp_failover = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.559480] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] allow_bulk = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.559614] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] api_extensions_path = {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.559745] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] api_paste_config = api-paste.ini {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.559879] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] auth_strategy = keystone {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.559981] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] backdoor_port = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.560092] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] backdoor_socket = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.560231] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] backlog = 4096 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.560365] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.560513] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] bind_host = 0.0.0.0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.560649] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] bind_port = 9696 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.560778] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] client_socket_timeout = 900 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.560913] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] config_dir = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.561025] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.561157] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] config_source = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.561292] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] control_exchange = neutron {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.561425] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] core_plugin = ml2 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.561583] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] debug = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.561713] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] default_availability_zones = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.561904] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.562048] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] dhcp_agent_notification = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.562180] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] dhcp_agents_per_network = 1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.562308] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] dhcp_lease_duration = 86400 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.562443] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] dhcp_load_type = networks {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.562572] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] dns_domain = openstacklocal {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.562708] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.562883] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] enable_default_route_bfd = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.562950] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] enable_default_route_ecmp = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.563075] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] enable_dvr = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.563223] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] enable_new_agents = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.563355] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.563478] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] enable_signals = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.563601] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] enable_traditional_dhcp = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.563721] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] external_dns_driver = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.563846] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] filter_validation = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.564089] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] global_physnet_mtu = 8950 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.564254] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] graceful_shutdown_timeout = 60 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.564430] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] host = cpu-1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.564570] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] host_dvr_for_dhcp = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.564699] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] http_retries = 3 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.564835] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] instance_format = [instance: %(uuid)s] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.564970] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.565123] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ipam_driver = internal {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.565256] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ipv6_pd_enabled = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.565384] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] l3_ha = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.565522] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.565651] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] l3_ha_network_physical_name = {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.565779] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] l3_ha_network_type = {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.565910] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_color = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.566049] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_config_append = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.566181] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.566309] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_dir = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.566431] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_file = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.566529] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_options = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.566660] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_rotate_interval = 1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.566793] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_rotate_interval_type = days {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.566926] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] log_rotation_type = none {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.567036] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.567136] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.567272] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.567403] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.567502] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.567631] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] max_dns_nameservers = 5 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.567757] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] max_header_line = 16384 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.567882] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] max_l3_agents_per_router = 3 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.568016] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] max_logfile_count = 30 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.568142] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] max_logfile_size_mb = 200 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.568268] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] max_subnet_host_routes = 20 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.568400] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] my_ip = 10.180.1.21 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.568530] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] my_ipv6 = ::1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.568655] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] network_auto_schedule = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.568776] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] network_link_prefix = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.568904] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.569044] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] notify_nova_on_port_data_changes = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.569181] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] notify_nova_on_port_status_changes = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.569315] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] pagination_max_limit = -1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.569441] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] publish_errors = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.569597] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] rate_limit_burst = 0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.569693] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] rate_limit_except_level = CRITICAL {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.569817] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] rate_limit_interval = 0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.569938] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] retry_until_window = 30 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.570071] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] router_distributed = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.570197] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] rpc_resources_processing_step = 20 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.570368] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] rpc_response_max_timeout = 600 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.570449] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] rpc_response_timeout = 60 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.570569] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] send_events_interval = 2 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.570708] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] service_plugins = ['router'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.570842] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] setproctitle = on {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.570964] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] shell_completion = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.571109] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] state_path = /opt/stack/data/neutron {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.571241] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] syslog_log_facility = LOG_USER {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.571368] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] tcp_keepidle = 600 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.571499] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] transport_url = **** {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.571623] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] use_journal = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.571747] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] use_json = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.571869] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] use_ssl = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.571989] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] use_stderr = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.572130] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] use_syslog = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.572253] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] vlan_qinq = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.572372] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] vlan_transparent = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.572496] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] watch_log_file = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.572620] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] wsgi_default_pool_size = 100 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.572744] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] wsgi_keep_alive = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.572929] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.573018] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] wsgi_server_debug = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 562.573176] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_concurrency.disable_process_locking = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.573332] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.573474] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.573607] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.573740] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.573873] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.574012] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.574199] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.connection_string = messaging:// {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.574351] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.enabled = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.574490] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.es_doc_type = notification {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.574621] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.es_scroll_size = 10000 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.574755] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.es_scroll_time = 2m {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.574883] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.filter_error_trace = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.575024] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.hmac_keys = **** {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.575161] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.sentinel_service_name = mymaster {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.575300] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.socket_timeout = 0.1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.575461] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.trace_requests = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.575564] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler.trace_sqlalchemy = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.575692] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler_jaeger.process_tags = {} {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.575818] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler_jaeger.service_name_prefix = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.575947] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] profiler_otlp.service_name_prefix = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.576102] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.enforce_new_defaults = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.576371] env[66157]: WARNING oslo_config.cfg [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 562.576517] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.enforce_scope = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.576656] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.policy_default_rule = default {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.576800] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.576936] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.577084] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.577215] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.577342] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.577468] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.577595] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.577730] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.577873] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.578025] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] agent.extensions = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.578166] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.578305] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] service_providers.service_provider = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.578497] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.default_quota = -1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.578666] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.578808] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_floatingip = 50 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.578938] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_network = 100 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.579081] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_port = 500 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.579215] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.579348] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_router = 10 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.579479] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_security_group = 10 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.579610] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.579746] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.quota_subnet = 100 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.579870] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] QUOTAS.track_quota_usage = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.580023] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.580152] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep.group = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.580283] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep.helper_command = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.580414] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep.log_daemon_traceback = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.580548] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.580682] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep.thread_pool_size = 8 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.580811] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep.user = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.580950] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.581112] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_dhcp_release.group = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.581250] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_dhcp_release.helper_command = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.581383] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.581516] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.581645] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.581772] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_dhcp_release.user = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.581907] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.582041] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_ovs_vsctl.group = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.582170] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.582301] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.582433] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.582563] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.582689] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_ovs_vsctl.user = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.582823] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_namespace.capabilities = [21] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.582951] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_namespace.group = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.583099] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_namespace.helper_command = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.583262] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.583407] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.583541] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.583669] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_namespace.user = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.583805] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_conntrack.capabilities = [12] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.583933] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_conntrack.group = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.584079] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_conntrack.helper_command = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.584231] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.584369] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.584503] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.584629] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_conntrack.user = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.584767] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_link.capabilities = [12, 21] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.584896] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_link.group = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.585033] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_link.helper_command = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.585167] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_link.log_daemon_traceback = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.585302] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.585433] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_link.thread_pool_size = 8 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.585558] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] privsep_link.user = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.585705] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.585849] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.585983] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.continue_on_failed_promotions = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.586125] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.dscp = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.586291] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.dscp_inherit = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.586443] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.force_mp_to_policy = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.586578] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.locking_coordinator_url = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.586713] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.log_agent_heartbeats = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.586844] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.logging_expire = 1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.586981] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.587129] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.587270] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.polling_interval = 240 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.587402] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.587539] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.587679] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.report_interval = 30.0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.587817] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.587954] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.588100] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.588237] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.sync_skew = 60 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.588371] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.synchronization_queue_size = 20 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.588502] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT.use_helper_for_ns_read = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.588643] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] SECURITYGROUP.enable_ipset = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.588783] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] SECURITYGROUP.enable_security_group = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.588921] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.589072] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.589218] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] experimental.ipv6_pd_enabled = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.589396] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.extension_drivers = ['port_security'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.589534] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.external_network_type = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.589682] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.589862] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.overlay_ip_version = 4 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.590046] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.path_mtu = 8950 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.590193] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.physical_network_mtus = {} {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.590342] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.590480] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.590621] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ml2.type_drivers = ['vlan'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.590764] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.590894] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.591056] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.591220] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.591364] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.591503] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.591643] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.591782] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.591956] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.592171] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.592343] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_login_password = **** {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.592495] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.592634] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_login_user = admin {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.592773] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.592911] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.593053] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.593210] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.593357] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.593499] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.593638] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.593775] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.593909] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.594060] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.594207] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.594344] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.594505] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.594707] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.594844] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.594980] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.595125] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.595293] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.auth_section = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.595450] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.auth_type = password {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.595590] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.595718] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.certfile = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.595852] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.collect_timing = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.595992] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.endpoint_type = public {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.596137] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.insecure = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.596263] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.keyfile = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.596401] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.region_name = RegionOne {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.596532] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.split_loggers = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.596663] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] nova.timeout = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.596798] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.auth_section = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.596938] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.auth_type = password {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.597083] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.597211] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.certfile = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.597342] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.collect_timing = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.597481] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.endpoint_type = public {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.597606] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.insecure = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.597728] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.keyfile = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.597852] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.region_name = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.597977] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.split_loggers = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.598117] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] placement.timeout = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.598270] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.auth_section = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.598408] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.auth_type = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.598534] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.cafile = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.598658] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.certfile = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.598786] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.collect_timing = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.598910] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.connect_retries = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.599044] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.connect_retry_delay = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.599173] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.enable_notifications = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.599298] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.endpoint_override = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.599426] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.insecure = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.599549] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.interface = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.599670] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.keyfile = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.599796] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.max_version = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.599989] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.min_version = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.600053] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.region_name = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.600159] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.retriable_status_codes = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.600280] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.service_name = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.600407] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.service_type = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.600534] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.split_loggers = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.600658] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.status_code_retries = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.600784] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.status_code_retry_delay = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.600910] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.timeout = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.601045] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.valid_interfaces = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.601196] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ironic.version = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.601343] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] cli_script.dry_run = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.601489] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.601621] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.601753] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.601886] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.602024] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.602158] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.602290] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.602419] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.602546] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.602684] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.602807] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.602941] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.603136] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.603259] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.603401] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.603524] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.603659] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.603791] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.603931] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.604074] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.604235] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.604374] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.604508] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.604638] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.604768] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.604899] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.605039] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.605174] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.605307] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.605441] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.605573] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.ssl = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.605708] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.605841] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.605970] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.606115] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.606252] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.606380] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.606517] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_notifications.driver = [] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.606646] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_notifications.retry = -1 {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.606790] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.606917] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 562.607021] env[66157]: DEBUG oslo_service.backend._eventlet.service [None req-a902f472-54e1-4414-862e-ca62ef662d63 None None] ******************************************************************************** {{(pid=66157) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 562.608180] env[66157]: DEBUG neutron.agent.securitygroups_rpc [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Init firewall settings (driver=nsxv3) {{(pid=66157) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 562.609511] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66157) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 562.609750] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] RPC agent_id: nsxm-l-01a.corp.local [ 562.612118] env[66157]: DEBUG dogpile.cache.region [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 562.612237] env[66157]: DEBUG dogpile.lock [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 562.612327] env[66157]: DEBUG dogpile.lock [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 562.612417] env[66157]: DEBUG dogpile.lock [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 562.612510] env[66157]: DEBUG dogpile.cache.region [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 562.612597] env[66157]: DEBUG dogpile.lock [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 562.612716] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 562.643335] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Session token - acquiring [ 562.645283] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.645453] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.645580] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.645977] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.657526] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.938935] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 562.960538] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 562.960710] env[66157]: DEBUG dogpile.cache.region [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Cache value generated in 0.348 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 562.960845] env[66157]: DEBUG dogpile.lock [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 562.960901] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Activating Policy API Provider. [ 562.961249] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Looking for the default Infrastructure Rules. [ 563.027817] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Looking for the Default Layer3 Logged Drop Section. [ 563.043813] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 563.044334] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.044504] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.044604] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.044896] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.045250] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.559688] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.061985] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.564249] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Inventory metadata is going to be refreshed. [ 564.564685] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 565.361469] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.361812] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.361812] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.362059] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.373777] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 565.374746] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.375359] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 565.394845] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.395272] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.395272] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.395502] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.395607] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.395805] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 565.395956] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.396105] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 565.416661] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.416928] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.416928] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.417255] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.417418] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.417542] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 565.436881] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.437112] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.437178] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.437443] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.437589] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.437734] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 565.455809] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.456067] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.456119] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.456435] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.456578] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.456720] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 565.456821] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.456920] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 565.474034] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.474264] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.474314] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.474617] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.474737] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.474877] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 565.474978] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.475097] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 565.495588] env[66157]: DEBUG networking_nsxv3.common.locking [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.495822] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.495865] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.496138] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.496301] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.496443] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 565.496542] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.496659] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Inventory metadata have been refreshed. [ 565.496736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Dryrun:True. Metadata refresh completed. [ 565.496869] env[66157]: DEBUG oslo_concurrency.lockutils [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Releasing lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.498709] env[66157]: INFO neutron.agent.agent_extensions_manager [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Loaded agent extensions: [] [ 565.499428] env[66157]: DEBUG neutron_lib.callbacks.manager [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66157) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 565.551697] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent RPC Daemon Started! [ 565.551878] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:0 started [ 565.551936] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent out of sync with plugin! [ 570.500164] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.500520] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.501445] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.501848] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.502704] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 580.503193] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.903313] env[66157]: INFO networking_nsxv3.common.synchronization [None req-67ca23de-6a44-4af6-bdbf-e585b1bce602 demo admin] Enqueued Resource ID: 47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4 with Priority: HIGHEST for action security_group_rules [ 580.904204] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4 with Priority: HIGHEST for action security_group_rules [ 580.904204] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.904308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.904308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.904615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.904699] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.424754] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.425024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.425024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.425178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.425271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.425415] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4 already deleted. [ 581.425472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f2e1b8-c0fe-4fad-bd26-4f806ec56ba4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.905318] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 585.905674] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 590.907089] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 590.907378] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 595.908811] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 595.909215] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 600.914028] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 600.914028] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 602.502345] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.502881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.502881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.502881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.503071] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.005861] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.508107] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.010400] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 604.010563] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 604.810364] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.810699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.810807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.811060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.822289] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 604.823158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.824157] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 604.843333] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.843483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.843554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.843758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.843844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.843953] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 604.844038] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 604.844112] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 604.865505] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.865682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.865728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.865939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.866097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.866207] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 604.889529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.889529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.889529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.889529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.889529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.889529] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 604.910828] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.911208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.911342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.911639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.911825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.912031] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 604.912342] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 604.912342] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 604.932373] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.932567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.932777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.933175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.933175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.933256] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 604.933342] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 604.933458] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 604.954261] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.954461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.954532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.954918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.955158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.955251] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 604.955332] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 604.955406] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 604.955473] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 604.955545] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 604.955610] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 604.955677] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 604.955957] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 604.956064] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 604.956146] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 604.977165] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.977453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.977453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.977608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.977988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.977988] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 604.997836] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.997989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.998059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.998265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.998370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.038758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.911428] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 605.911787] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 607.020748] env[66157]: INFO networking_nsxv3.common.synchronization [None req-14c7e715-83c0-44ca-9295-1f1885f28a18 None None] Enqueued Resource ID: a612a88f-a625-414d-aa65-63b417a74461 with Priority: HIGHEST for action port [ 607.020748] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a612a88f-a625-414d-aa65-63b417a74461 with Priority: HIGHEST for action port [ 607.021284] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a612a88f-a625-414d-aa65-63b417a74461 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.021409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a612a88f-a625-414d-aa65-63b417a74461" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.021528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a612a88f-a625-414d-aa65-63b417a74461" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.021723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a612a88f-a625-414d-aa65-63b417a74461" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.021806] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a612a88f-a625-414d-aa65-63b417a74461',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.524148] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a612a88f-a625-414d-aa65-63b417a74461 [ 607.526025] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.526025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.526025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.526025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.526025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.526025] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a612a88f-a625-414d-aa65-63b417a74461 already deleted. [ 607.526025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a612a88f-a625-414d-aa65-63b417a74461" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.806026] env[66157]: INFO networking_nsxv3.common.synchronization [None req-80fa6ed9-eac0-488d-ae62-50eeb2b9ce39 None None] Enqueued Resource ID: 198286ab-a184-478a-84bb-fe8f69791b04 with Priority: HIGHEST for action port [ 608.806026] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198286ab-a184-478a-84bb-fe8f69791b04 with Priority: HIGHEST for action port [ 608.806026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-198286ab-a184-478a-84bb-fe8f69791b04 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.806026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-198286ab-a184-478a-84bb-fe8f69791b04" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.806026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-198286ab-a184-478a-84bb-fe8f69791b04" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.806026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-198286ab-a184-478a-84bb-fe8f69791b04" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.806736] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('198286ab-a184-478a-84bb-fe8f69791b04',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.309257] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 198286ab-a184-478a-84bb-fe8f69791b04 [ 609.309509] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.309664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.309726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.309954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.310065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.310163] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:198286ab-a184-478a-84bb-fe8f69791b04 already deleted. [ 609.310262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-198286ab-a184-478a-84bb-fe8f69791b04" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.434555] env[66157]: INFO networking_nsxv3.common.synchronization [None req-2c34e9b8-49a7-4cb3-b342-c3edef669117 None None] Enqueued Resource ID: 6e9502a3-12ff-4a0a-ac9d-83c6ace64398 with Priority: HIGHEST for action port [ 609.434750] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9502a3-12ff-4a0a-ac9d-83c6ace64398 with Priority: HIGHEST for action port [ 609.435668] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e9502a3-12ff-4a0a-ac9d-83c6ace64398 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.437143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e9502a3-12ff-4a0a-ac9d-83c6ace64398" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.437143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e9502a3-12ff-4a0a-ac9d-83c6ace64398" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.437143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e9502a3-12ff-4a0a-ac9d-83c6ace64398" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.437143] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e9502a3-12ff-4a0a-ac9d-83c6ace64398',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.938271] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e9502a3-12ff-4a0a-ac9d-83c6ace64398 [ 609.939741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.939741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.939741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.939741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.939741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.939741] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e9502a3-12ff-4a0a-ac9d-83c6ace64398 already deleted. [ 609.939741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e9502a3-12ff-4a0a-ac9d-83c6ace64398" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.587323] env[66157]: INFO networking_nsxv3.common.synchronization [None req-eb7539ed-ebf1-4a89-a20f-5c06814f6511 None None] Enqueued Resource ID: 7a0241b9-ef31-4587-9ff5-6582a2cdbcdf with Priority: HIGHEST for action port [ 611.587824] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a0241b9-ef31-4587-9ff5-6582a2cdbcdf with Priority: HIGHEST for action port [ 611.588153] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a0241b9-ef31-4587-9ff5-6582a2cdbcdf taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.588254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a0241b9-ef31-4587-9ff5-6582a2cdbcdf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.588431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a0241b9-ef31-4587-9ff5-6582a2cdbcdf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.588670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a0241b9-ef31-4587-9ff5-6582a2cdbcdf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.588670] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a0241b9-ef31-4587-9ff5-6582a2cdbcdf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.092437] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a0241b9-ef31-4587-9ff5-6582a2cdbcdf [ 612.092703] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.093146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.093146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.093146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.093373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.093373] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a0241b9-ef31-4587-9ff5-6582a2cdbcdf already deleted. [ 612.093427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a0241b9-ef31-4587-9ff5-6582a2cdbcdf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.126972] env[66157]: INFO networking_nsxv3.common.synchronization [None req-247349f1-32c6-4837-bc52-b36bee891502 None None] Enqueued Resource ID: bc7fbf81-65c9-44f2-90d7-d79428706847 with Priority: HIGHEST for action port [ 612.127225] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7fbf81-65c9-44f2-90d7-d79428706847 with Priority: HIGHEST for action port [ 612.128122] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc7fbf81-65c9-44f2-90d7-d79428706847 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.128122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc7fbf81-65c9-44f2-90d7-d79428706847" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.128122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc7fbf81-65c9-44f2-90d7-d79428706847" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.128662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc7fbf81-65c9-44f2-90d7-d79428706847" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.128755] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc7fbf81-65c9-44f2-90d7-d79428706847',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.288188] env[66157]: INFO networking_nsxv3.common.synchronization [None req-26b88dea-148f-451d-bf03-64de99f7b722 None None] Enqueued Resource ID: b3fe3faa-9f24-42c0-9a05-229937785aa1 with Priority: HIGHEST for action port [ 612.288188] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3fe3faa-9f24-42c0-9a05-229937785aa1 with Priority: HIGHEST for action port [ 612.288188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3fe3faa-9f24-42c0-9a05-229937785aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.288813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3fe3faa-9f24-42c0-9a05-229937785aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.289122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3fe3faa-9f24-42c0-9a05-229937785aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.289927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3fe3faa-9f24-42c0-9a05-229937785aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.290138] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3fe3faa-9f24-42c0-9a05-229937785aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.631334] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc7fbf81-65c9-44f2-90d7-d79428706847 [ 612.631551] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.631682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.631752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.631958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.633181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.633310] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc7fbf81-65c9-44f2-90d7-d79428706847 already deleted. [ 612.633420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc7fbf81-65c9-44f2-90d7-d79428706847" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.793400] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3fe3faa-9f24-42c0-9a05-229937785aa1 [ 612.793400] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.793400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.793400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.793400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.793400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.793400] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3fe3faa-9f24-42c0-9a05-229937785aa1 already deleted. [ 612.793400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3fe3faa-9f24-42c0-9a05-229937785aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.469108] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f6fff256-3bc6-47fd-a3bd-3022ce0a40ee None None] Enqueued Resource ID: cafd077f-098f-4c56-b445-832f9af87de8 with Priority: HIGHEST for action port [ 614.469655] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cafd077f-098f-4c56-b445-832f9af87de8 with Priority: HIGHEST for action port [ 614.469989] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-cafd077f-098f-4c56-b445-832f9af87de8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.470131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cafd077f-098f-4c56-b445-832f9af87de8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.470200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cafd077f-098f-4c56-b445-832f9af87de8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.470438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cafd077f-098f-4c56-b445-832f9af87de8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.470527] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cafd077f-098f-4c56-b445-832f9af87de8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.792733] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f117ba8f-3096-442a-82b9-2f56c6dbbcb2 None None] Enqueued Resource ID: 58bee50f-157a-42fb-b7c8-f020a3b2a330 with Priority: HIGHEST for action port [ 614.796077] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bee50f-157a-42fb-b7c8-f020a3b2a330 with Priority: HIGHEST for action port [ 614.796077] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-58bee50f-157a-42fb-b7c8-f020a3b2a330 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.796077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58bee50f-157a-42fb-b7c8-f020a3b2a330" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.796077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58bee50f-157a-42fb-b7c8-f020a3b2a330" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.796077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58bee50f-157a-42fb-b7c8-f020a3b2a330" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.796077] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58bee50f-157a-42fb-b7c8-f020a3b2a330',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.974024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cafd077f-098f-4c56-b445-832f9af87de8 [ 614.974540] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.974735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.974811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.975085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.975183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.975280] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cafd077f-098f-4c56-b445-832f9af87de8 already deleted. [ 614.975365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cafd077f-098f-4c56-b445-832f9af87de8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.298140] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58bee50f-157a-42fb-b7c8-f020a3b2a330 [ 615.298406] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.298570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.298624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.298831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.299601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.300037] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58bee50f-157a-42fb-b7c8-f020a3b2a330 already deleted. [ 615.300037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58bee50f-157a-42fb-b7c8-f020a3b2a330" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.940038] env[66157]: INFO networking_nsxv3.common.synchronization [None req-74f6c706-504b-4a6d-8a19-a269169558db None None] Enqueued Resource ID: 7089082b-41f2-4eff-8513-b450a9c5b5e1 with Priority: HIGHEST for action port [ 615.940038] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7089082b-41f2-4eff-8513-b450a9c5b5e1 with Priority: HIGHEST for action port [ 615.940038] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-7089082b-41f2-4eff-8513-b450a9c5b5e1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.940038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7089082b-41f2-4eff-8513-b450a9c5b5e1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.940038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7089082b-41f2-4eff-8513-b450a9c5b5e1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.940038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7089082b-41f2-4eff-8513-b450a9c5b5e1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.940038] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7089082b-41f2-4eff-8513-b450a9c5b5e1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.284407] env[66157]: INFO networking_nsxv3.common.synchronization [None req-052ab6ae-ad5b-4653-add6-edc9fa857b70 None None] Enqueued Resource ID: 419da62b-2b68-4f20-9853-1381b3e1b728 with Priority: HIGHEST for action port [ 616.286361] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 419da62b-2b68-4f20-9853-1381b3e1b728 with Priority: HIGHEST for action port [ 616.286361] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-419da62b-2b68-4f20-9853-1381b3e1b728 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.286361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-419da62b-2b68-4f20-9853-1381b3e1b728" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.286361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-419da62b-2b68-4f20-9853-1381b3e1b728" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.286361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-419da62b-2b68-4f20-9853-1381b3e1b728" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.286361] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419da62b-2b68-4f20-9853-1381b3e1b728',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.444284] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7089082b-41f2-4eff-8513-b450a9c5b5e1 [ 616.444629] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.444979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.444979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.445183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.445431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.445606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7089082b-41f2-4eff-8513-b450a9c5b5e1 already deleted. [ 616.445735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7089082b-41f2-4eff-8513-b450a9c5b5e1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.795497] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 419da62b-2b68-4f20-9853-1381b3e1b728 [ 616.795720] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.795976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.795976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.796320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.796320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.796320] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:419da62b-2b68-4f20-9853-1381b3e1b728 already deleted. [ 616.796490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-419da62b-2b68-4f20-9853-1381b3e1b728" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.827903] env[66157]: INFO networking_nsxv3.common.synchronization [None req-425f071b-e5be-4d90-924d-75f62962e68d None None] Enqueued Resource ID: de62b721-1e1c-4958-9c43-379902b98aa6 with Priority: HIGHEST for action port [ 617.828482] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de62b721-1e1c-4958-9c43-379902b98aa6 with Priority: HIGHEST for action port [ 617.828807] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-de62b721-1e1c-4958-9c43-379902b98aa6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.828929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de62b721-1e1c-4958-9c43-379902b98aa6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.828993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de62b721-1e1c-4958-9c43-379902b98aa6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.829441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de62b721-1e1c-4958-9c43-379902b98aa6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.829535] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de62b721-1e1c-4958-9c43-379902b98aa6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.332800] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de62b721-1e1c-4958-9c43-379902b98aa6 [ 618.333075] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.333555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.333555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.333555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.333555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.333942] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de62b721-1e1c-4958-9c43-379902b98aa6 already deleted. [ 618.333942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de62b721-1e1c-4958-9c43-379902b98aa6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.471162] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f2cb12b9-00a1-4e57-bcf0-f48ac8c5b77f None None] Enqueued Resource ID: ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de with Priority: HIGHEST for action port [ 618.471911] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de with Priority: HIGHEST for action port [ 618.472700] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.473031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.473197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.473572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.473710] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.976171] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de [ 618.976624] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.976862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.976993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.978238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.978905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.978905] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de already deleted. [ 618.978905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee251c7c-7ff5-40bb-8bd5-04ad2a2db3de" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.290576] env[66157]: INFO networking_nsxv3.common.synchronization [None req-a14dd1ad-f876-438f-81a0-f1ba3570a1e3 None None] Enqueued Resource ID: 0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f with Priority: HIGHEST for action port [ 619.291466] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f with Priority: HIGHEST for action port [ 619.291786] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.291910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.294086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.294366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.294456] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.445543] env[66157]: INFO networking_nsxv3.common.synchronization [None req-801c2cc3-58b5-4b56-a4ff-6a1e37446c1c None None] Enqueued Resource ID: b72aa718-bf68-4a1b-b48d-acd83f7074af with Priority: HIGHEST for action port [ 619.445903] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72aa718-bf68-4a1b-b48d-acd83f7074af with Priority: HIGHEST for action port [ 619.446688] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b72aa718-bf68-4a1b-b48d-acd83f7074af taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.446688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b72aa718-bf68-4a1b-b48d-acd83f7074af" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.446688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b72aa718-bf68-4a1b-b48d-acd83f7074af" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.448153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b72aa718-bf68-4a1b-b48d-acd83f7074af" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.448153] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72aa718-bf68-4a1b-b48d-acd83f7074af',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.798393] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f [ 619.798875] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.798875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.798875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.799106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.799106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.799208] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f already deleted. [ 619.800321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ad335e1-3dd7-4a75-b9b0-d87fe41fcd5f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.953072] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b72aa718-bf68-4a1b-b48d-acd83f7074af [ 619.953348] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.953458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.953529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.953728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.953818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.953911] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b72aa718-bf68-4a1b-b48d-acd83f7074af already deleted. [ 619.953991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b72aa718-bf68-4a1b-b48d-acd83f7074af" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.861773] env[66157]: INFO networking_nsxv3.common.synchronization [None req-a3711933-1cad-48d2-bbbd-e01cfc812ad1 tempest-VolumesAssistedSnapshotsTest-581408467 tempest-VolumesAssistedSnapshotsTest-581408467-project-member] Enqueued Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_rules [ 622.863054] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_rules [ 622.863424] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da4877d5-58b5-4fb9-8430-89b4ff018611 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.863546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.863612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.863897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.863957] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.963633] env[66157]: INFO networking_nsxv3.common.synchronization [None req-8adfcb13-9e50-473f-bda5-423d6a6ee66a tempest-VolumesAssistedSnapshotsTest-581408467 tempest-VolumesAssistedSnapshotsTest-581408467-project-member] Enqueued Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_rules [ 622.964222] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_rules [ 622.964518] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da4877d5-58b5-4fb9-8430-89b4ff018611 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.964618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.266796] env[66157]: INFO networking_nsxv3.common.synchronization [None req-7829c4ec-7526-432a-a732-83583ab679ea None None] Enqueued Resource ID: f234ca23-f193-4888-8d61-0cc8070438ed with Priority: HIGHEST for action port [ 623.267064] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f234ca23-f193-4888-8d61-0cc8070438ed with Priority: HIGHEST for action port [ 623.267639] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-f234ca23-f193-4888-8d61-0cc8070438ed taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.267775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f234ca23-f193-4888-8d61-0cc8070438ed" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.267836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f234ca23-f193-4888-8d61-0cc8070438ed" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.269877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f234ca23-f193-4888-8d61-0cc8070438ed" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.272379] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f234ca23-f193-4888-8d61-0cc8070438ed',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.390134] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.390322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.390322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.390516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.390621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.390720] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da4877d5-58b5-4fb9-8430-89b4ff018611 already deleted. [ 623.390803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.390951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.391117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.391447] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.776319] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f234ca23-f193-4888-8d61-0cc8070438ed [ 623.776319] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.776319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.776319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.776319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.776319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.776319] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f234ca23-f193-4888-8d61-0cc8070438ed already deleted. [ 623.776319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f234ca23-f193-4888-8d61-0cc8070438ed" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.913550] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.914513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.914513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.914513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.914706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.914800] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da4877d5-58b5-4fb9-8430-89b4ff018611 already deleted. [ 623.914884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.539302] env[66157]: INFO networking_nsxv3.common.synchronization [None req-d2df71f1-3710-4589-bac6-9f6aa9f8300d None None] Enqueued Resource ID: 12b3cb01-b123-4c75-9ace-26e5d13774c4 with Priority: HIGHEST for action port [ 624.539936] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b3cb01-b123-4c75-9ace-26e5d13774c4 with Priority: HIGHEST for action port [ 624.540304] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-12b3cb01-b123-4c75-9ace-26e5d13774c4 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.540487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12b3cb01-b123-4c75-9ace-26e5d13774c4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.540690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12b3cb01-b123-4c75-9ace-26e5d13774c4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.540964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12b3cb01-b123-4c75-9ace-26e5d13774c4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.541097] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12b3cb01-b123-4c75-9ace-26e5d13774c4',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.841212] env[66157]: INFO networking_nsxv3.common.synchronization [None req-22b5186c-a7ae-4aac-b0f8-627f2a577aa4 None None] Enqueued Resource ID: aaa76d21-fb92-4a79-b52c-2277dc9d942e with Priority: HIGHEST for action port [ 624.841723] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaa76d21-fb92-4a79-b52c-2277dc9d942e with Priority: HIGHEST for action port [ 624.842707] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaa76d21-fb92-4a79-b52c-2277dc9d942e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.843572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaa76d21-fb92-4a79-b52c-2277dc9d942e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.843669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaa76d21-fb92-4a79-b52c-2277dc9d942e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.843893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaa76d21-fb92-4a79-b52c-2277dc9d942e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.844083] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaa76d21-fb92-4a79-b52c-2277dc9d942e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.046179] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12b3cb01-b123-4c75-9ace-26e5d13774c4 [ 625.046179] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.046495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.046495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.046566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.046719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.046719] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12b3cb01-b123-4c75-9ace-26e5d13774c4 already deleted. [ 625.046798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12b3cb01-b123-4c75-9ace-26e5d13774c4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.281834] env[66157]: INFO networking_nsxv3.common.synchronization [req-0941b525-a50b-421d-8d0b-779b0c2d3a16 req-3a33fc35-4c0c-407d-9bb4-aabeaa4a58f7 tempest-FloatingIPsAssociationTestJSON-1906195860 tempest-FloatingIPsAssociationTestJSON-1906195860-project-member] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 625.282419] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 625.282752] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.282876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.283257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.284472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.284657] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.284840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.284840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.285092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.285193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.285275] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.347339] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaa76d21-fb92-4a79-b52c-2277dc9d942e [ 625.347579] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.348473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.348473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.348473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.348473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.348473] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaa76d21-fb92-4a79-b52c-2277dc9d942e already deleted. [ 625.348473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaa76d21-fb92-4a79-b52c-2277dc9d942e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.790023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.790023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.790023] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 already deleted. [ 625.790023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.114477] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.114765] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.114814] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.115630] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.115979] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.116655] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.117150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.117418] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.117642] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.118068] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.120030] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.120030] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.120030] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.120030] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.120030] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.120030] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.142345] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.142427] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.142578] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.142891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.143992] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-7afeebc6-8175-43fb-abd1-842bd17eaccd taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.143992] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-7afeebc6-8175-43fb-abd1-842bd17eaccd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.143992] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-7afeebc6-8175-43fb-abd1-842bd17eaccd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.143992] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-7afeebc6-8175-43fb-abd1-842bd17eaccd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.144259] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7afeebc6-8175-43fb-abd1-842bd17eaccd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.647839] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.648748] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.649030] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.649492] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.649753] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.650319] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 7afeebc6-8175-43fb-abd1-842bd17eaccd not found, creating... [ 626.650912] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.651237] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.652050] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.652377] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.652601] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.653142] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.653373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.653546] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.654484] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.654699] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.654911] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 7afeebc6-8175-43fb-abd1-842bd17eaccd is going to be created. [ 626.678791] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.679605] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.679814] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.680239] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.680491] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.680800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-7afeebc6-8175-43fb-abd1-842bd17eaccd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.477585] env[66157]: INFO networking_nsxv3.common.synchronization [req-0941b525-a50b-421d-8d0b-779b0c2d3a16 req-209bd275-54a2-4aaf-8695-24b99092e8dd service nova] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_rules [ 627.477838] env[66157]: INFO networking_nsxv3.common.synchronization [req-0941b525-a50b-421d-8d0b-779b0c2d3a16 req-209bd275-54a2-4aaf-8695-24b99092e8dd service nova] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 627.477895] env[66157]: INFO networking_nsxv3.common.synchronization [req-0941b525-a50b-421d-8d0b-779b0c2d3a16 req-209bd275-54a2-4aaf-8695-24b99092e8dd service nova] Enqueued Resource ID: 7afeebc6-8175-43fb-abd1-842bd17eaccd with Priority: HIGHEST for action port [ 627.478432] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_rules [ 627.478574] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 627.478694] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afeebc6-8175-43fb-abd1-842bd17eaccd with Priority: HIGHEST for action port [ 627.478976] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.479580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.479670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.479988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.480057] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.481322] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.481644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.481723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.481898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.482056] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.482157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.482221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.482491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.483742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.483742] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.485541] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-7afeebc6-8175-43fb-abd1-842bd17eaccd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.485657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7afeebc6-8175-43fb-abd1-842bd17eaccd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.485757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7afeebc6-8175-43fb-abd1-842bd17eaccd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.485880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7afeebc6-8175-43fb-abd1-842bd17eaccd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.485957] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7afeebc6-8175-43fb-abd1-842bd17eaccd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.677070] env[66157]: INFO networking_nsxv3.common.synchronization [None req-135cd73b-fc15-4b45-a7a5-231ae6e09c8b None None] Enqueued Resource ID: d458952c-1827-4e89-ab80-5b655b92df6e with Priority: HIGHEST for action port [ 627.677639] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d458952c-1827-4e89-ab80-5b655b92df6e with Priority: HIGHEST for action port [ 627.678130] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d458952c-1827-4e89-ab80-5b655b92df6e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.678263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d458952c-1827-4e89-ab80-5b655b92df6e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.678332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d458952c-1827-4e89-ab80-5b655b92df6e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.678576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d458952c-1827-4e89-ab80-5b655b92df6e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.678809] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d458952c-1827-4e89-ab80-5b655b92df6e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.981661] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.981825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.986169] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.987744] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7afeebc6-8175-43fb-abd1-842bd17eaccd with status ACTIVE [ 627.988029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.988152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.988239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.988420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.988501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.990406] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.990406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.990406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.990406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.990406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.990406] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.990406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.990406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.990406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.990406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.990406] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7afeebc6-8175-43fb-abd1-842bd17eaccd is going to be updated. [ 628.010800] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.011014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.011014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.011234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.011374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.011533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7afeebc6-8175-43fb-abd1-842bd17eaccd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.157360] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e90fdf4-c04a-4bcf-820d-ace232ee28d9 req-d843bcda-5341-463b-bf80-0429a0860c8c tempest-ServerDiagnosticsTest-1247298712 tempest-ServerDiagnosticsTest-1247298712-project-member] Enqueued Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGHEST for action security_group_members [ 628.157659] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGHEST for action security_group_members [ 628.157944] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b02819-f659-4343-b709-2e63116c5829 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.158397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.158397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.158397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.158522] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.158629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.158689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.158847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.158940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.159844] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.181423] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d458952c-1827-4e89-ab80-5b655b92df6e [ 628.181642] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.181775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.181845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.182069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.182160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.182253] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d458952c-1827-4e89-ab80-5b655b92df6e already deleted. [ 628.182330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d458952c-1827-4e89-ab80-5b655b92df6e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.488697] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.664391] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.664626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.664800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.665093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.665199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.665403] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.665695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.665695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.665822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.665905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.665992] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b02819-f659-4343-b709-2e63116c5829 already deleted. [ 628.666086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.992121] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.992408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.992501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.992711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.992817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.992926] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 is going to be created. [ 629.024836] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.025028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.025107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.025354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.025518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.039688] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: UNINITIALIZED for 2s [ 629.231433] env[66157]: INFO networking_nsxv3.common.synchronization [None req-89b5b427-8aed-4db6-a473-744bd721f1ee None None] Enqueued Resource ID: cffd1159-40aa-4e53-9f27-7d94bdcccd18 with Priority: HIGHEST for action port [ 629.231875] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cffd1159-40aa-4e53-9f27-7d94bdcccd18 with Priority: HIGHEST for action port [ 629.232124] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-cffd1159-40aa-4e53-9f27-7d94bdcccd18 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.232219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cffd1159-40aa-4e53-9f27-7d94bdcccd18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.232282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cffd1159-40aa-4e53-9f27-7d94bdcccd18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.232824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cffd1159-40aa-4e53-9f27-7d94bdcccd18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.232954] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cffd1159-40aa-4e53-9f27-7d94bdcccd18',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.455748] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0670cf7a-e0c1-4339-a13a-7ca0101b0b5a None None] Enqueued Resource ID: 44ee0ba1-db12-45ca-9098-aa728a82eeab with Priority: HIGHEST for action port [ 629.456762] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ee0ba1-db12-45ca-9098-aa728a82eeab with Priority: HIGHEST for action port [ 629.457383] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-44ee0ba1-db12-45ca-9098-aa728a82eeab taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.457626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44ee0ba1-db12-45ca-9098-aa728a82eeab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.458015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44ee0ba1-db12-45ca-9098-aa728a82eeab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.459119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44ee0ba1-db12-45ca-9098-aa728a82eeab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.459119] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44ee0ba1-db12-45ca-9098-aa728a82eeab',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.566119] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.566553] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.566553] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.566675] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.567019] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.567140] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.567230] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.567445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.567582] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.567777] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.567884] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.567979] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.568094] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.568280] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.568280] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.568404] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.595668] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.595836] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.596012] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.596206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.596507] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-3bb82f6a-df4b-44a5-811d-aec661b7023d taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.596666] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-3bb82f6a-df4b-44a5-811d-aec661b7023d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.596772] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-3bb82f6a-df4b-44a5-811d-aec661b7023d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.597093] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-3bb82f6a-df4b-44a5-811d-aec661b7023d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.597235] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bb82f6a-df4b-44a5-811d-aec661b7023d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.735640] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cffd1159-40aa-4e53-9f27-7d94bdcccd18 [ 629.735881] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.736030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.736103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.736316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.736404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.736500] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cffd1159-40aa-4e53-9f27-7d94bdcccd18 already deleted. [ 629.736579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cffd1159-40aa-4e53-9f27-7d94bdcccd18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.907543] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0c1613f2-5593-40ca-96be-6863bf4c2497 None None] Enqueued Resource ID: f2ca64f1-b618-45d2-95da-0ed22663aac2 with Priority: HIGHEST for action port [ 629.907803] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ca64f1-b618-45d2-95da-0ed22663aac2 with Priority: HIGHEST for action port [ 629.908763] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2ca64f1-b618-45d2-95da-0ed22663aac2 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.908763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2ca64f1-b618-45d2-95da-0ed22663aac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.908763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2ca64f1-b618-45d2-95da-0ed22663aac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.908981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2ca64f1-b618-45d2-95da-0ed22663aac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.908981] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2ca64f1-b618-45d2-95da-0ed22663aac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.961596] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44ee0ba1-db12-45ca-9098-aa728a82eeab [ 629.961596] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.961596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.961596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.961820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.961861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.961947] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44ee0ba1-db12-45ca-9098-aa728a82eeab already deleted. [ 629.962039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44ee0ba1-db12-45ca-9098-aa728a82eeab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.099859] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.100110] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.100228] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.100514] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.100687] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.100844] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 3bb82f6a-df4b-44a5-811d-aec661b7023d not found, creating... [ 630.101114] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.101266] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.101416] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.101664] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.101825] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.102108] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.102265] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.102376] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.102572] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.102710] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.102850] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 3bb82f6a-df4b-44a5-811d-aec661b7023d is going to be created. [ 630.125686] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.125888] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.125934] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.126239] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.126486] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.126661] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-3bb82f6a-df4b-44a5-811d-aec661b7023d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.410735] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2ca64f1-b618-45d2-95da-0ed22663aac2 [ 630.410975] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.411212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.411332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.411571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.411695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.411816] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2ca64f1-b618-45d2-95da-0ed22663aac2 already deleted. [ 630.411921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2ca64f1-b618-45d2-95da-0ed22663aac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.839409] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e90fdf4-c04a-4bcf-820d-ace232ee28d9 req-467e763b-ad06-4d8a-a886-031176584b2e service nova] Enqueued Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGHEST for action security_group_rules [ 630.839700] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e90fdf4-c04a-4bcf-820d-ace232ee28d9 req-467e763b-ad06-4d8a-a886-031176584b2e service nova] Enqueued Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGHEST for action security_group_members [ 630.839743] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e90fdf4-c04a-4bcf-820d-ace232ee28d9 req-467e763b-ad06-4d8a-a886-031176584b2e service nova] Enqueued Resource ID: 3bb82f6a-df4b-44a5-811d-aec661b7023d with Priority: HIGHEST for action port [ 630.840310] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGHEST for action security_group_rules [ 630.840418] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGHEST for action security_group_members [ 630.840510] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb82f6a-df4b-44a5-811d-aec661b7023d with Priority: HIGHEST for action port [ 630.841042] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b02819-f659-4343-b709-2e63116c5829 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.841311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.841311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.841647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.841743] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.842661] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b02819-f659-4343-b709-2e63116c5829 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.842844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.842911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.843093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.843386] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.843386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.843556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.843556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.843634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.843823] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.845266] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bb82f6a-df4b-44a5-811d-aec661b7023d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.845498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bb82f6a-df4b-44a5-811d-aec661b7023d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.845498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bb82f6a-df4b-44a5-811d-aec661b7023d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.845647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bb82f6a-df4b-44a5-811d-aec661b7023d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.845647] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bb82f6a-df4b-44a5-811d-aec661b7023d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.050036] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: SUCCESS [ 631.053861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.053861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.053861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.054075] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.054699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.054699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.054699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.054699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.054699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.054699] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.348534] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b02819-f659-4343-b709-2e63116c5829 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.348681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.363483] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bb82f6a-df4b-44a5-811d-aec661b7023d with status ACTIVE [ 631.364531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.364531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.364531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.364531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.364531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.364531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.364531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.364853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.364853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.364853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.364997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.365074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.365107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.365704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.365704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.365704] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bb82f6a-df4b-44a5-811d-aec661b7023d is going to be updated. [ 631.369057] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.391371] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.391696] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.391925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.392210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.392463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.392816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bb82f6a-df4b-44a5-811d-aec661b7023d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.559353] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.559353] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.559353] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.559353] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.559353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.559982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.559982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.559982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.559982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.559982] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.643313] env[66157]: INFO networking_nsxv3.common.synchronization [None req-66ff7b6a-c471-4e7b-b1b6-8bb92335db60 None None] Enqueued Resource ID: d46bf499-5942-4007-9847-e15c08effe7a with Priority: HIGHEST for action port [ 631.643313] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46bf499-5942-4007-9847-e15c08effe7a with Priority: HIGHEST for action port [ 631.643502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d46bf499-5942-4007-9847-e15c08effe7a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.643502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d46bf499-5942-4007-9847-e15c08effe7a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.643607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d46bf499-5942-4007-9847-e15c08effe7a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.643870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d46bf499-5942-4007-9847-e15c08effe7a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.643988] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d46bf499-5942-4007-9847-e15c08effe7a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.871521] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.976600] env[66157]: INFO networking_nsxv3.common.synchronization [req-702ad7c5-a243-4e26-8ab8-e43e9e4114a6 req-34c1ddd8-cfe8-404d-ad86-7271786f94e8 tempest-TenantUsagesTestJSON-242047630 tempest-TenantUsagesTestJSON-242047630-project-member] Enqueued Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGHEST for action security_group_members [ 631.977797] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGHEST for action security_group_members [ 631.978346] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9050a2e-a60d-4614-aa8f-0f8639b64779 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.978512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.978652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.978905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.979547] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.979702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.979821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.980982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.981188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.981188] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.063194] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13cfa8de-e28e-458d-8572-75b45f56b222: rpc.has_security_group_logging(os_id): False [ 632.084402] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.084604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.084820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.086138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.086138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.086439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.086580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.086729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.087263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.087263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.087600] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.088693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.088782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.088954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.089062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.089603] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.089603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.089603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.089603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.089806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.090788] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 is going to be created. [ 632.150058] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d46bf499-5942-4007-9847-e15c08effe7a [ 632.150058] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.150058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.150058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.150058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.150058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.150058] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d46bf499-5942-4007-9847-e15c08effe7a already deleted. [ 632.150058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d46bf499-5942-4007-9847-e15c08effe7a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.155562] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.155562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.155562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.155562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.155562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.167077] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: IN_PROGRESS for 2s [ 632.376127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.376127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.376127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.376127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.376127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.376127] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b02819-f659-4343-b709-2e63116c5829 is going to be created. [ 632.401858] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.402042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.402111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.402308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.402918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.413423] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b02819-f659-4343-b709-2e63116c5829 in Status: UNINITIALIZED for 2s [ 632.423574] env[66157]: INFO networking_nsxv3.common.synchronization [None req-c65f230b-35c4-4d7e-94c4-9f1395e95c9d None None] Enqueued Resource ID: ea96a288-9943-426e-9bd1-ba5df0129baf with Priority: HIGHEST for action port [ 632.423836] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea96a288-9943-426e-9bd1-ba5df0129baf with Priority: HIGHEST for action port [ 632.427767] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea96a288-9943-426e-9bd1-ba5df0129baf taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.429075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea96a288-9943-426e-9bd1-ba5df0129baf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.429075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea96a288-9943-426e-9bd1-ba5df0129baf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.429075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea96a288-9943-426e-9bd1-ba5df0129baf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.429075] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea96a288-9943-426e-9bd1-ba5df0129baf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.430585] env[66157]: INFO networking_nsxv3.common.synchronization [None req-317d48c7-6f87-4226-a164-e89b59776aff None None] Enqueued Resource ID: 2034c454-e6bf-4ad3-ada6-94e1ec181fb3 with Priority: HIGHEST for action port [ 632.431408] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2034c454-e6bf-4ad3-ada6-94e1ec181fb3 with Priority: HIGHEST for action port [ 632.432508] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2034c454-e6bf-4ad3-ada6-94e1ec181fb3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.432508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2034c454-e6bf-4ad3-ada6-94e1ec181fb3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.432508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2034c454-e6bf-4ad3-ada6-94e1ec181fb3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.432688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2034c454-e6bf-4ad3-ada6-94e1ec181fb3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.432890] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2034c454-e6bf-4ad3-ada6-94e1ec181fb3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.483975] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.484182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.484257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.484474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.484621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.484757] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.484856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.484917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.485100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.485180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.485310] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 already deleted. [ 632.485347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.617487] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.617683] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.617798] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.618064] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.618310] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.618456] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.618561] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.618772] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.618904] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.619388] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.619546] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.619695] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.619846] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.619965] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.620083] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.620225] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.640773] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.641083] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.643225] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.643453] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.643821] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-d263fac3-9fc6-4e37-b9e1-415580eb962f taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.644182] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-d263fac3-9fc6-4e37-b9e1-415580eb962f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.644182] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-d263fac3-9fc6-4e37-b9e1-415580eb962f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.644486] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-d263fac3-9fc6-4e37-b9e1-415580eb962f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.644692] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d263fac3-9fc6-4e37-b9e1-415580eb962f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.792316] env[66157]: INFO networking_nsxv3.common.synchronization [req-5439257b-45a7-463b-970d-7f1cf28f0b3b req-cccfaf66-1b76-45e1-b2b1-7e2ac7ab49ef tempest-DeleteServersAdminTestJSON-1142677805 tempest-DeleteServersAdminTestJSON-1142677805-project-member] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 632.792906] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 632.793266] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.793399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.793462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.793899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.794197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.794197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.794317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.794465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.794498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.794586] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.931678] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea96a288-9943-426e-9bd1-ba5df0129baf [ 632.931972] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.932053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.932113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.932322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.932509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.933148] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea96a288-9943-426e-9bd1-ba5df0129baf already deleted. [ 632.933148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea96a288-9943-426e-9bd1-ba5df0129baf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.935064] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2034c454-e6bf-4ad3-ada6-94e1ec181fb3 [ 632.935249] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.935389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.935608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.935674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.935736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.935792] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2034c454-e6bf-4ad3-ada6-94e1ec181fb3 already deleted. [ 632.935984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2034c454-e6bf-4ad3-ada6-94e1ec181fb3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.150021] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.150021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.150021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.150021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.150021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.150021] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port d263fac3-9fc6-4e37-b9e1-415580eb962f not found, creating... [ 633.150021] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.150021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.150021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.150021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.150021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.150620] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.150620] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.150620] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.150620] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.150620] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.150620] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: d263fac3-9fc6-4e37-b9e1-415580eb962f is going to be created. [ 633.170749] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.170915] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.171013] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.171336] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.171573] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.171789] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-d263fac3-9fc6-4e37-b9e1-415580eb962f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.298042] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.298211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.298312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.298514] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.298654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.298860] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.298982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.299083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.299265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.299363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.299455] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 already deleted. [ 633.299562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.606674] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.606877] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.607022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.607277] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.607542] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.607690] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.607800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.608040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.608171] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.608366] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.608469] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.608570] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.608668] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.608778] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.608879] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.611614] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.628097] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.628270] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.628406] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.628575] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.628881] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-1ddaef8d-7dca-4475-91ce-ed953e63533a taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.629060] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-1ddaef8d-7dca-4475-91ce-ed953e63533a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.629188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-1ddaef8d-7dca-4475-91ce-ed953e63533a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.629514] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-1ddaef8d-7dca-4475-91ce-ed953e63533a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.629657] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ddaef8d-7dca-4475-91ce-ed953e63533a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.912096] env[66157]: INFO networking_nsxv3.common.synchronization [req-702ad7c5-a243-4e26-8ab8-e43e9e4114a6 req-22217e77-bc42-4447-ab7d-fea471bc06fb service nova] Enqueued Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGHEST for action security_group_rules [ 633.912323] env[66157]: INFO networking_nsxv3.common.synchronization [req-702ad7c5-a243-4e26-8ab8-e43e9e4114a6 req-22217e77-bc42-4447-ab7d-fea471bc06fb service nova] Enqueued Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGHEST for action security_group_members [ 633.912461] env[66157]: INFO networking_nsxv3.common.synchronization [req-702ad7c5-a243-4e26-8ab8-e43e9e4114a6 req-22217e77-bc42-4447-ab7d-fea471bc06fb service nova] Enqueued Resource ID: d263fac3-9fc6-4e37-b9e1-415580eb962f with Priority: HIGHEST for action port [ 633.912781] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGHEST for action security_group_rules [ 633.912913] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGHEST for action security_group_members [ 633.912992] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d263fac3-9fc6-4e37-b9e1-415580eb962f with Priority: HIGHEST for action port [ 633.913514] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9050a2e-a60d-4614-aa8f-0f8639b64779 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.913640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.913712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.913961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.914050] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.914862] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9050a2e-a60d-4614-aa8f-0f8639b64779 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.914974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.915053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.915216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.915359] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.915449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.915510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.915644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.915728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.915814] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.916725] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d263fac3-9fc6-4e37-b9e1-415580eb962f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.916835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d263fac3-9fc6-4e37-b9e1-415580eb962f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.917115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d263fac3-9fc6-4e37-b9e1-415580eb962f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.917115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d263fac3-9fc6-4e37-b9e1-415580eb962f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.917115] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d263fac3-9fc6-4e37-b9e1-415580eb962f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.131555] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.132040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.132040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.132196] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.132342] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.132488] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 1ddaef8d-7dca-4475-91ce-ed953e63533a not found, creating... [ 634.132763] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.132919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.133049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.133304] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.133446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.133734] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.133882] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.133994] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.134206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.134334] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.134465] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 1ddaef8d-7dca-4475-91ce-ed953e63533a is going to be created. [ 634.155428] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.155625] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.155747] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.156023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.156245] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.156463] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-1ddaef8d-7dca-4475-91ce-ed953e63533a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.178561] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: SUCCESS [ 634.178817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.419229] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.420113] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9050a2e-a60d-4614-aa8f-0f8639b64779 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.420277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.420367] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d263fac3-9fc6-4e37-b9e1-415580eb962f with status ACTIVE [ 634.420520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.420664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.420735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.420932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.421035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.421236] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.421367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.421410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.421559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.421643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.421804] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.421897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.421957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.422825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.422929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.423043] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d263fac3-9fc6-4e37-b9e1-415580eb962f is going to be updated. [ 634.425396] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b02819-f659-4343-b709-2e63116c5829 in Status: SUCCESS [ 634.425583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.425931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.426127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.427398] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.427398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.427398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.427398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.427398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.427398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.427398] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.453819] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.454026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.454101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.454344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.454497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.454684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d263fac3-9fc6-4e37-b9e1-415580eb962f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.886808] env[66157]: INFO networking_nsxv3.common.synchronization [req-5439257b-45a7-463b-970d-7f1cf28f0b3b req-14d31ac0-cd8d-4696-9d9a-f61d5cab0ec0 service nova] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_rules [ 634.887244] env[66157]: INFO networking_nsxv3.common.synchronization [req-5439257b-45a7-463b-970d-7f1cf28f0b3b req-14d31ac0-cd8d-4696-9d9a-f61d5cab0ec0 service nova] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 634.887244] env[66157]: INFO networking_nsxv3.common.synchronization [req-5439257b-45a7-463b-970d-7f1cf28f0b3b req-14d31ac0-cd8d-4696-9d9a-f61d5cab0ec0 service nova] Enqueued Resource ID: 1ddaef8d-7dca-4475-91ce-ed953e63533a with Priority: HIGHEST for action port [ 634.887817] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_rules [ 634.888086] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 634.888278] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ddaef8d-7dca-4475-91ce-ed953e63533a with Priority: HIGHEST for action port [ 634.888531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.888676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.888746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.889074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.889190] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.892999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.893182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.893257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.893559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.893707] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.893837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.893906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.895608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.895709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.895961] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.897273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ddaef8d-7dca-4475-91ce-ed953e63533a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.897396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ddaef8d-7dca-4475-91ce-ed953e63533a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.897455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ddaef8d-7dca-4475-91ce-ed953e63533a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.897659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ddaef8d-7dca-4475-91ce-ed953e63533a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.897739] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ddaef8d-7dca-4475-91ce-ed953e63533a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.927046] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.931746] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b02819-f659-4343-b709-2e63116c5829 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.931746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.931746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.931746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.931746] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.931746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.931746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.931746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.931746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.931746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.931746] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b02819-f659-4343-b709-2e63116c5829 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.932193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.932193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.932193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.932193] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.932326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.932326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.932453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.932497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.932557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.932642] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.404119] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.404119] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.404119] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ddaef8d-7dca-4475-91ce-ed953e63533a with status ACTIVE [ 635.404119] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.404119] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.404119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.405204] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.405204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.405204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.405311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.405576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.405576] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ddaef8d-7dca-4475-91ce-ed953e63533a is going to be updated. [ 635.431299] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.431299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.431299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.431299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.431762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.431762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ddaef8d-7dca-4475-91ce-ed953e63533a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.432258] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.432443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.432443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.432701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.432915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.433091] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 is going to be created. [ 635.439349] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5b02819-f659-4343-b709-2e63116c5829: rpc.has_security_group_logging(os_id): False [ 635.455919] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.456107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.456161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.456447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.456447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.456608] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.456704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.456766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.456936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.457027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.457208] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.457390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.457390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.457473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.457551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.457717] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.457804] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.457885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.457986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.458317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.458409] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b02819-f659-4343-b709-2e63116c5829 is going to be created. [ 635.461904] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.462011] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.462053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.462218] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.462366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.471621] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 in Status: UNINITIALIZED for 2s [ 635.520071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.520071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.520071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.520071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.520071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.534047] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b02819-f659-4343-b709-2e63116c5829 in Status: IN_PROGRESS for 2s [ 635.595622] env[66157]: INFO networking_nsxv3.common.synchronization [None req-634e4dbc-c584-4bfb-ac62-75e6a3058725 None None] Enqueued Resource ID: a1a7e245-1b75-4c72-8056-3a9221ad1f4d with Priority: HIGHEST for action port [ 635.596220] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a7e245-1b75-4c72-8056-3a9221ad1f4d with Priority: HIGHEST for action port [ 635.596549] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1a7e245-1b75-4c72-8056-3a9221ad1f4d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.596678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1a7e245-1b75-4c72-8056-3a9221ad1f4d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.596767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1a7e245-1b75-4c72-8056-3a9221ad1f4d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.597048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1a7e245-1b75-4c72-8056-3a9221ad1f4d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.597148] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a7e245-1b75-4c72-8056-3a9221ad1f4d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.704453] env[66157]: INFO networking_nsxv3.common.synchronization [req-0fcc185e-9f51-4a52-8689-7df79de29b2b req-50fdd773-36f4-4972-babb-d7a71e445feb tempest-ServerDiagnosticsNegativeTest-1765692284 tempest-ServerDiagnosticsNegativeTest-1765692284-project-member] Enqueued Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGHEST for action security_group_members [ 635.705177] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGHEST for action security_group_members [ 635.705331] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06552dc4-54b0-463a-af1a-33bc39af0c0c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.705437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.705495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.705698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.705853] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.705954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.706314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.706675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.706675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.706769] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.907744] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.046254] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.046444] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.046541] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.046809] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.047088] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.047246] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.047359] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.047568] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.047731] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.047964] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.048079] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.048217] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.048376] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.048526] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.048635] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.048760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.061366] env[66157]: INFO networking_nsxv3.common.synchronization [req-6bd16aa7-5431-408c-9c02-3f61dada087b req-512a0e9c-f89e-4a8d-add2-046d548784c3 tempest-MigrationsAdminTest-406320684 tempest-MigrationsAdminTest-406320684-project-member] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 636.061843] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 636.062152] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.062275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.062378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.062624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.062766] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.063173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.063245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.063403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.063493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.063586] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.069127] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.069127] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.069127] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.069127] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.069127] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-ac5a661a-0584-44b3-84e2-32facd970628 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.069127] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-ac5a661a-0584-44b3-84e2-32facd970628" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.069127] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-ac5a661a-0584-44b3-84e2-32facd970628" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.069127] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-ac5a661a-0584-44b3-84e2-32facd970628" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.069127] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac5a661a-0584-44b3-84e2-32facd970628',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.099521] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1a7e245-1b75-4c72-8056-3a9221ad1f4d [ 636.099743] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.099880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.099953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.100192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.100286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.100385] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1a7e245-1b75-4c72-8056-3a9221ad1f4d already deleted. [ 636.100467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1a7e245-1b75-4c72-8056-3a9221ad1f4d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.211093] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.212317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.212317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.212317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.212317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.212317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.212317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.212317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.212678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.212678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.212843] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c already deleted. [ 636.212878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.413565] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.413965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.413965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.414089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.414089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.414198] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 is going to be created. [ 636.446968] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.447078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.447150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.447725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.447725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.462228] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: UNINITIALIZED for 2s [ 636.565963] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.565963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.565963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.566464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.566464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.566464] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.566599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.566599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.566915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.566915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.566915] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 already deleted. [ 636.567156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.571702] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.571905] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.572054] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.572312] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.572463] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.572607] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port ac5a661a-0584-44b3-84e2-32facd970628 not found, creating... [ 636.572920] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.573048] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.573157] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.573406] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.573541] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.573818] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.573991] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.574184] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.574474] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.574632] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.574797] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: ac5a661a-0584-44b3-84e2-32facd970628 is going to be created. [ 636.577829] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.578049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.578114] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.578327] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.578558] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.578700] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.578808] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.579031] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.579513] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.579714] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.579825] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.579932] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.580045] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.580152] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.580250] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.580367] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.603991] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.604090] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.604183] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.604364] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.604904] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.605266] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.605420] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.605815] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.605987] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ddeca4d-39ac-4aa8-a58e-122bef8c8aff',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.607752] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.608204] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.608204] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.608442] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.608694] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.608941] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-ac5a661a-0584-44b3-84e2-32facd970628" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.111193] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.111464] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.111591] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.111864] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.112035] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.112174] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 3ddeca4d-39ac-4aa8-a58e-122bef8c8aff not found, creating... [ 637.112867] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.112867] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.112867] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.113268] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.113268] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.113519] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.113675] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.113822] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.114059] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.114237] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.114321] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 3ddeca4d-39ac-4aa8-a58e-122bef8c8aff is going to be created. [ 637.138545] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.138760] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.138879] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.139208] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.139415] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.139644] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.384065] env[66157]: INFO networking_nsxv3.common.synchronization [req-0fcc185e-9f51-4a52-8689-7df79de29b2b req-5f31c46a-5c2c-47be-ba6c-38c486693135 service nova] Enqueued Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGHEST for action security_group_rules [ 637.384397] env[66157]: INFO networking_nsxv3.common.synchronization [req-0fcc185e-9f51-4a52-8689-7df79de29b2b req-5f31c46a-5c2c-47be-ba6c-38c486693135 service nova] Enqueued Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGHEST for action security_group_members [ 637.384698] env[66157]: INFO networking_nsxv3.common.synchronization [req-0fcc185e-9f51-4a52-8689-7df79de29b2b req-5f31c46a-5c2c-47be-ba6c-38c486693135 service nova] Enqueued Resource ID: ac5a661a-0584-44b3-84e2-32facd970628 with Priority: HIGHEST for action port [ 637.385234] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGHEST for action security_group_rules [ 637.385378] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGHEST for action security_group_members [ 637.385500] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5a661a-0584-44b3-84e2-32facd970628 with Priority: HIGHEST for action port [ 637.385821] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06552dc4-54b0-463a-af1a-33bc39af0c0c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.386559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.386559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.386559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.386559] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.389191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06552dc4-54b0-463a-af1a-33bc39af0c0c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.389191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.389191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.389191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.389191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.389191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.389191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.389191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.390159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.390159] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.390345] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac5a661a-0584-44b3-84e2-32facd970628 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.390456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac5a661a-0584-44b3-84e2-32facd970628" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.390516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac5a661a-0584-44b3-84e2-32facd970628" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.390713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac5a661a-0584-44b3-84e2-32facd970628" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.390790] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac5a661a-0584-44b3-84e2-32facd970628',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.482857] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 in Status: SUCCESS [ 637.482857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.483338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.483338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.483504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.483504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.483600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.484210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.484210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.484210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.484210] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.546232] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b02819-f659-4343-b709-2e63116c5829 in Status: SUCCESS [ 637.546466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.837493] env[66157]: INFO networking_nsxv3.common.synchronization [req-6bd16aa7-5431-408c-9c02-3f61dada087b req-2d228140-7728-4eb3-9d60-9dc5f670caa2 service nova] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_rules [ 637.837665] env[66157]: INFO networking_nsxv3.common.synchronization [req-6bd16aa7-5431-408c-9c02-3f61dada087b req-2d228140-7728-4eb3-9d60-9dc5f670caa2 service nova] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 637.837799] env[66157]: INFO networking_nsxv3.common.synchronization [req-6bd16aa7-5431-408c-9c02-3f61dada087b req-2d228140-7728-4eb3-9d60-9dc5f670caa2 service nova] Enqueued Resource ID: 3ddeca4d-39ac-4aa8-a58e-122bef8c8aff with Priority: HIGHEST for action port [ 637.838428] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_rules [ 637.838660] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 637.838660] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ddeca4d-39ac-4aa8-a58e-122bef8c8aff with Priority: HIGHEST for action port [ 637.838867] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.838957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.839060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.839294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.839383] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.840277] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.840339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.840371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.841553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.841553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.841553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.841553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.841553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.841553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.841553] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.842109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.842228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.842228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.842618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.842618] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ddeca4d-39ac-4aa8-a58e-122bef8c8aff',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.892845] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06552dc4-54b0-463a-af1a-33bc39af0c0c taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.893098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.893220] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.894062] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac5a661a-0584-44b3-84e2-32facd970628 with status ACTIVE [ 637.894225] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.894343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.894470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.894663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.894663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.895755] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.895755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.895755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.895755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.895755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.895755] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.895755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.895755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.895755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.895755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.896435] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac5a661a-0584-44b3-84e2-32facd970628 is going to be updated. [ 637.918029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.918029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.918195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.918388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.918562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.918756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac5a661a-0584-44b3-84e2-32facd970628" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.987825] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9050a2e-a60d-4614-aa8f-0f8639b64779 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.987986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.988070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.988282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.988444] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.988544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.988613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.989018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.989018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.989018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.989168] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9050a2e-a60d-4614-aa8f-0f8639b64779 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.989215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.989245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.989376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.989507] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.989596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.989656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.989788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.989888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.989968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.990071] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.006084] env[66157]: INFO networking_nsxv3.common.synchronization [None req-64ba409b-fbba-4444-8cd8-e255e33fd71b None None] Enqueued Resource ID: 6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9 with Priority: HIGHEST for action port [ 638.006084] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9 with Priority: HIGHEST for action port [ 638.006084] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.006084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.007306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.007909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.008190] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.345591] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.348176] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.348176] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ddeca4d-39ac-4aa8-a58e-122bef8c8aff with status ACTIVE [ 638.348176] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.348176] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.348176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.348654] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.348654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.348654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.348654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.348654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.348819] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ddeca4d-39ac-4aa8-a58e-122bef8c8aff is going to be updated. [ 638.377977] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.377977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.377977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.377977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.377977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.377977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ddeca4d-39ac-4aa8-a58e-122bef8c8aff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.397962] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.475091] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: SUCCESS [ 638.475091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.475091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.475091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.475091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.475091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.475542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.475542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475542] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.497283] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9050a2e-a60d-4614-aa8f-0f8639b64779: rpc.has_security_group_logging(os_id): False [ 638.511613] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9 [ 638.511856] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.511991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.512124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.512354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.512446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.512545] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9 already deleted. [ 638.512646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb215d2-6d9a-474c-80d8-e0a0d4b5f0a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.521633] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.521798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.521860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.522102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.522200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.522447] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.522613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.522674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.522858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.522984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.523312] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.523416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.523497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.523628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.523696] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.523936] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.524076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.524076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.524228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.524336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.524420] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 is going to be created. [ 638.553526] env[66157]: INFO networking_nsxv3.common.synchronization [req-f06c6094-a3b6-4e75-ad2e-54870f9cf1a1 req-64cd4905-a5c8-44c0-86ab-d0cc448efdc7 tempest-VolumesAssistedSnapshotsTest-581408467 tempest-VolumesAssistedSnapshotsTest-581408467-project-member] Enqueued Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_members [ 638.554123] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_members [ 638.554429] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4877d5-58b5-4fb9-8430-89b4ff018611 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.554641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.554641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.554884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.555444] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.556040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.556110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.556287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.556498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.556498] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.593978] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.594133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.594587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.594587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.594587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.612615] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 in Status: IN_PROGRESS for 2s [ 638.852269] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.900441] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.900661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.900818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.901368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.901480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.901635] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c is going to be created. [ 638.925888] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.926067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.926114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.926330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.926490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.940702] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c in Status: UNINITIALIZED for 2s [ 638.979300] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.979531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.979531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.979834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.979937] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.980055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.980136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.980289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.980376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.980470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.980634] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.980728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.980778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.980918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.981082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.981216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.981313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.981538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.981650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.981739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.981830] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.059226] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.059409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.059560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.059746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.059802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.059957] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.060074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.060137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.060329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.060364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.060434] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4877d5-58b5-4fb9-8430-89b4ff018611 already deleted. [ 639.060506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.101343] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.101531] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-774" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.101674] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-774" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.102016] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-774" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.103207] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.103562] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.103731] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.104350] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.104613] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.104820] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.104962] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.105177] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.105331] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.105469] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.105598] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.105809] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.124699] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.124864] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.124997] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.125243] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-774" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.125581] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.125715] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.125830] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.126216] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.126348] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97df6ff6-6d55-4d30-bba9-5a32fd35d9ab',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.358120] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.358348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.359020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.359020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.359020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.359020] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 is going to be created. [ 639.386346] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.386576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.386671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.386926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.387225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.398628] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: UNINITIALIZED for 2s [ 639.485711] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8851c268-64f4-45b7-bb1b-82bd0da298c8: rpc.has_security_group_logging(os_id): False [ 639.509341] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.509632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.509675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.510534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.510534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.510534] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.510534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.510534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.510754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.510754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.511368] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.511368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.511368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.511368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.511509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.511734] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.511874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.511974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.512169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.512275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.512386] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 is going to be created. [ 639.580608] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.580772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.580862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.581133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.581345] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.593013] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: IN_PROGRESS for 2s [ 639.629136] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.629238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.629357] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.629623] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.629773] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.629919] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 97df6ff6-6d55-4d30-bba9-5a32fd35d9ab not found, creating... [ 639.630184] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.630335] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.630445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.630683] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.630826] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.631115] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.631345] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.631511] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.631724] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.631855] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.631996] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 97df6ff6-6d55-4d30-bba9-5a32fd35d9ab is going to be created. [ 639.666262] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.666495] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.666597] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.666887] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.667139] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.667365] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.415044] env[66157]: INFO networking_nsxv3.common.synchronization [req-f06c6094-a3b6-4e75-ad2e-54870f9cf1a1 req-0753ac04-8b93-4a5b-ade5-6fc2ed3e8ce3 service nova] Enqueued Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_rules [ 640.415044] env[66157]: INFO networking_nsxv3.common.synchronization [req-f06c6094-a3b6-4e75-ad2e-54870f9cf1a1 req-0753ac04-8b93-4a5b-ade5-6fc2ed3e8ce3 service nova] Enqueued Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_members [ 640.415044] env[66157]: INFO networking_nsxv3.common.synchronization [req-f06c6094-a3b6-4e75-ad2e-54870f9cf1a1 req-0753ac04-8b93-4a5b-ade5-6fc2ed3e8ce3 service nova] Enqueued Resource ID: 97df6ff6-6d55-4d30-bba9-5a32fd35d9ab with Priority: HIGHEST for action port [ 640.416714] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_rules [ 640.416714] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_members [ 640.416714] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97df6ff6-6d55-4d30-bba9-5a32fd35d9ab with Priority: HIGHEST for action port [ 640.416927] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da4877d5-58b5-4fb9-8430-89b4ff018611 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.416927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.417079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.418170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.418170] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.418504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4877d5-58b5-4fb9-8430-89b4ff018611 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.418570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.418606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.418865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.419077] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.419585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.419585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.420806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.421063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.421335] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.422717] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.422717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.422717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.422935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.422935] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97df6ff6-6d55-4d30-bba9-5a32fd35d9ab',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.626345] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 in Status: SUCCESS [ 640.626709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.719752] env[66157]: INFO networking_nsxv3.common.synchronization [req-b33ba29a-2e16-497d-b59d-8cf65fa7a097 req-b6253ed3-d1c9-46d3-8de8-3ecf894829de tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 640.719752] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 640.719915] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.720094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.720137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.720423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.720604] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.720704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.720768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.720930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.721028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.721123] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.926373] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4877d5-58b5-4fb9-8430-89b4ff018611 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.926373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.926373] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.927409] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97df6ff6-6d55-4d30-bba9-5a32fd35d9ab with status ACTIVE [ 640.927705] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.927916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.928457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.928639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.928921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.929183] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.929911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.929911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.929911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.930058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.930406] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.930613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.930753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.931055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.931178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.931311] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97df6ff6-6d55-4d30-bba9-5a32fd35d9ab is going to be updated. [ 640.952737] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c in Status: SUCCESS [ 640.953429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.955069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.955069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.955069] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.955069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.955069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.955069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.955069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.955069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.955069] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.958349] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.958349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.958349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.958349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.958349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.958349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97df6ff6-6d55-4d30-bba9-5a32fd35d9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.124220] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.124220] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.124220] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.124493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.124673] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.124828] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.125178] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.125426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.125599] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.125803] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.125914] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.126029] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.126134] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.126248] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.126346] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.126477] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.145613] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.145781] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.145938] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.146103] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.146430] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-1f6c13e9-091e-4d21-af63-b1a686f7fde0 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.146592] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-1f6c13e9-091e-4d21-af63-b1a686f7fde0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.146708] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-1f6c13e9-091e-4d21-af63-b1a686f7fde0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.147067] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-1f6c13e9-091e-4d21-af63-b1a686f7fde0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.147217] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f6c13e9-091e-4d21-af63-b1a686f7fde0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.223081] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.223387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.223387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.223617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.223750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.223972] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.224103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.224157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.224302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.224437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.224494] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 already deleted. [ 641.224543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.410673] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: SUCCESS [ 641.410954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.411206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.411370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.411594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.411723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.411807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.411992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.412079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.412171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.412270] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.433796] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.456946] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06552dc4-54b0-463a-af1a-33bc39af0c0c taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.457166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.457236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.457670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.457670] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.457823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.457871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.458033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.458134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.458216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.458366] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06552dc4-54b0-463a-af1a-33bc39af0c0c taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.458471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.458534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.459307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.459307] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.459307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.459307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.459307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.459307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.459659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.459659] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.608668] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: SUCCESS [ 641.608934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.649792] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.650251] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.650251] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.650419] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.650558] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.650712] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 1f6c13e9-091e-4d21-af63-b1a686f7fde0 not found, creating... [ 641.651066] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.651320] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.651385] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.651559] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.651690] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.651964] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.652130] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.652238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.652442] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.652660] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.652709] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 1f6c13e9-091e-4d21-af63-b1a686f7fde0 is going to be created. [ 641.675484] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.675692] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.675807] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.676118] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.676380] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.676605] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-1f6c13e9-091e-4d21-af63-b1a686f7fde0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.916186] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.916394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.916394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.916591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.916759] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.916759] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.917032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.917073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.917167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.917305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.917536] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.917677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.917770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.917936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.918122] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.918213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.918601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.918601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.918601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.918601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.918601] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.936151] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.936316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.936359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.936553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.936620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.936714] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4877d5-58b5-4fb9-8430-89b4ff018611 is going to be created. [ 641.962339] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06552dc4-54b0-463a-af1a-33bc39af0c0c: rpc.has_security_group_logging(os_id): False [ 641.964789] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.964959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.965058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.965311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.965543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.980660] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4877d5-58b5-4fb9-8430-89b4ff018611 in Status: UNINITIALIZED for 2s [ 641.985456] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.985675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.985799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.986140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.986320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.986641] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.986820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.986946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.987220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.987356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.987674] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.988072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.988072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.989331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.989331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.989331] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.989331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.989331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.989331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.989706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.989706] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c is going to be created. [ 642.070906] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.071127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.071210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.071407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.071592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.085847] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c in Status: IN_PROGRESS for 2s [ 642.421146] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1: rpc.has_security_group_logging(os_id): False [ 642.435857] env[66157]: INFO networking_nsxv3.common.synchronization [req-b33ba29a-2e16-497d-b59d-8cf65fa7a097 req-c1d30a0f-217d-4ab0-bd2b-c68e87d80bbe service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 642.435857] env[66157]: INFO networking_nsxv3.common.synchronization [req-b33ba29a-2e16-497d-b59d-8cf65fa7a097 req-c1d30a0f-217d-4ab0-bd2b-c68e87d80bbe service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 642.435986] env[66157]: INFO networking_nsxv3.common.synchronization [req-b33ba29a-2e16-497d-b59d-8cf65fa7a097 req-c1d30a0f-217d-4ab0-bd2b-c68e87d80bbe service nova] Enqueued Resource ID: 1f6c13e9-091e-4d21-af63-b1a686f7fde0 with Priority: HIGHEST for action port [ 642.436576] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 642.436710] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 642.436806] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6c13e9-091e-4d21-af63-b1a686f7fde0 with Priority: HIGHEST for action port [ 642.437093] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.437229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.437324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.437621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.437707] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.438675] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.438776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.438857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.439083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.439248] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.439395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.439491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.439716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.439798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.439891] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.441234] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f6c13e9-091e-4d21-af63-b1a686f7fde0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.441370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f6c13e9-091e-4d21-af63-b1a686f7fde0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.441439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f6c13e9-091e-4d21-af63-b1a686f7fde0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.441671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f6c13e9-091e-4d21-af63-b1a686f7fde0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.441742] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f6c13e9-091e-4d21-af63-b1a686f7fde0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.443189] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.443316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.443376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.443527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.443609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.443778] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.443869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.443984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.446042] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.446042] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.446042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.446042] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 is going to be created. [ 642.507460] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.507661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.508208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.508208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.508371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.519480] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: IN_PROGRESS for 2s [ 642.611067] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f87baa73-69dc-4272-ae5e-ffd8d2ee41c0 None None] Enqueued Resource ID: b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18 with Priority: HIGHEST for action port [ 642.611298] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18 with Priority: HIGHEST for action port [ 642.611745] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.611745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.611745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.611977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.612024] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.949317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.949317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.949317] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.953303] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f6c13e9-091e-4d21-af63-b1a686f7fde0 with status ACTIVE [ 642.953303] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.953303] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.953303] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.953303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.953968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.953968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.953968] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f6c13e9-091e-4d21-af63-b1a686f7fde0 is going to be updated. [ 642.978690] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.978843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.979016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.979549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.979549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.979680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f6c13e9-091e-4d21-af63-b1a686f7fde0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.119035] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18 [ 643.119035] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.119035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.119035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.119035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.119035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.119035] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18 already deleted. [ 643.119035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9fb3c2e-3ad2-41f1-8306-cda5e7a77f18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.455851] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.959326] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.959785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.959887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.960294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.960471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.960649] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be created. [ 643.992402] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.992639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.992639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.992972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.993183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.997030] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4877d5-58b5-4fb9-8430-89b4ff018611 in Status: SUCCESS [ 643.997030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.997030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.997030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.997431] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.997694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.997871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.998150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.998318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.998482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.999097] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.007851] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: UNINITIALIZED for 2s [ 644.101531] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c in Status: SUCCESS [ 644.101768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.504778] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.535583] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: SUCCESS [ 644.536584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.973517] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0a052df2-1591-48bb-97dd-c4c429446e1b None None] Enqueued Resource ID: 4403717f-b6de-454a-9c32-39a526eb7b2f with Priority: HIGHEST for action port [ 644.974273] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4403717f-b6de-454a-9c32-39a526eb7b2f with Priority: HIGHEST for action port [ 644.974674] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-4403717f-b6de-454a-9c32-39a526eb7b2f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.974828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4403717f-b6de-454a-9c32-39a526eb7b2f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.974967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4403717f-b6de-454a-9c32-39a526eb7b2f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.975252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4403717f-b6de-454a-9c32-39a526eb7b2f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.975372] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4403717f-b6de-454a-9c32-39a526eb7b2f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.007907] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da4877d5-58b5-4fb9-8430-89b4ff018611: rpc.has_security_group_logging(os_id): False [ 645.033199] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.033199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.033199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.033377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.033407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.033676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.034374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.034374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.034374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.034374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.034374] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da4877d5-58b5-4fb9-8430-89b4ff018611 is going to be created. [ 645.117030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.117720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.117720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.117720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.117985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.133999] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da4877d5-58b5-4fb9-8430-89b4ff018611 in Status: IN_PROGRESS for 2s [ 645.478147] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4403717f-b6de-454a-9c32-39a526eb7b2f [ 645.478411] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.478558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.478637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.478859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.478944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.479287] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4403717f-b6de-454a-9c32-39a526eb7b2f already deleted. [ 645.479287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4403717f-b6de-454a-9c32-39a526eb7b2f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.019396] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 646.020879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.020879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.020879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.020879] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.020879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.020879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.020879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.021625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.021625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.021625] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.485336] env[66157]: INFO networking_nsxv3.common.synchronization [req-c538d0a4-5a4a-45df-8a09-a9e6c034f9b0 req-dfa34e55-7293-4852-8d26-b031a3b41766 tempest-ServerExternalEventsTest-1956610848 tempest-ServerExternalEventsTest-1956610848-project-member] Enqueued Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGHEST for action security_group_members [ 646.485583] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGHEST for action security_group_members [ 646.485878] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c792349-7376-489a-b7da-3c608db236ad taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.486330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.486751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.487064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.487312] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.487467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.487571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.487758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.487884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.488017] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.524927] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.525134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.525183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.525542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.525615] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.525756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.525811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.525976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.526156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.526156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.526294] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.526440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.526440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.526614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.526744] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.526838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.526912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.527084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.527178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.527296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.527425] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.951603] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.951603] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.951603] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.952070] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.952793] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.953273] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.953633] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.954048] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.955018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.955018] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.955018] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.955018] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.955729] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.956285] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.956668] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.957057] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.980198] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.980198] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.980198] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.980198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.980198] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.980198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.980198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.980198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.980198] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.991700] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.991849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.991849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.992370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.992370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.992370] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.992370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.992600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.992600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.992669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.992725] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c792349-7376-489a-b7da-3c608db236ad already deleted. [ 646.992797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.033312] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7e2acfe-17af-4683-bd94-9fc47ded2886: rpc.has_security_group_logging(os_id): False [ 647.051360] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.051360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.051360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.051360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.051360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.052886] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.052886] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.052886] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.052886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.053625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.053625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.053625] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be created. [ 647.119627] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.119773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.119844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.120072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.120255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.133449] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 647.146695] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da4877d5-58b5-4fb9-8430-89b4ff018611 in Status: SUCCESS [ 647.146983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.483319] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.483556] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.483697] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.484085] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.484266] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.484477] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9 not found, creating... [ 647.484797] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.484989] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.485212] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.485401] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.485539] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.486115] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.486115] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.486304] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.486435] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.486906] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.486906] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9 is going to be created. [ 647.513875] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.514959] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.514959] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.514959] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.514959] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.516376] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.631933] env[66157]: INFO networking_nsxv3.common.synchronization [None req-8ba00d19-03f2-4e6f-8317-b3f2b66f956e tempest-ServersWithSpecificFlavorTestJSON-563142723 tempest-ServersWithSpecificFlavorTestJSON-563142723-project-member] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_rules [ 647.632673] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_rules [ 647.633155] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.633342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.633501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.633755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.633871] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.131089] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0c096474-409b-4572-ad7e-ef0c8955ab64 tempest-ServersWithSpecificFlavorTestJSON-563142723 tempest-ServersWithSpecificFlavorTestJSON-563142723-project-member] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_rules [ 648.131711] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_rules [ 648.132021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.132145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.154362] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.154600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.154600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.154795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.154964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.154964] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f already deleted. [ 648.155309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.155309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.155662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.155662] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.204650] env[66157]: INFO networking_nsxv3.common.synchronization [req-c538d0a4-5a4a-45df-8a09-a9e6c034f9b0 req-58cc6072-b6f6-4eb5-a76c-3d8abdbf8dc8 service nova] Enqueued Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGHEST for action security_group_rules [ 648.204850] env[66157]: INFO networking_nsxv3.common.synchronization [req-c538d0a4-5a4a-45df-8a09-a9e6c034f9b0 req-58cc6072-b6f6-4eb5-a76c-3d8abdbf8dc8 service nova] Enqueued Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGHEST for action security_group_members [ 648.204974] env[66157]: INFO networking_nsxv3.common.synchronization [req-c538d0a4-5a4a-45df-8a09-a9e6c034f9b0 req-58cc6072-b6f6-4eb5-a76c-3d8abdbf8dc8 service nova] Enqueued Resource ID: fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9 with Priority: HIGHEST for action port [ 648.205481] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGHEST for action security_group_rules [ 648.205620] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGHEST for action security_group_members [ 648.205755] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9 with Priority: HIGHEST for action port [ 648.206349] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c792349-7376-489a-b7da-3c608db236ad taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.206631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.206631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.206770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.206937] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.209603] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c792349-7376-489a-b7da-3c608db236ad taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.209803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.209984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.210174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.211471] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.211471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.211471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.211471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.211471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.211471] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.212546] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.212546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.214142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.214142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.214142] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.682243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.682489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.682592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.682888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.683040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.683145] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f already deleted. [ 648.683259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.715255] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c792349-7376-489a-b7da-3c608db236ad taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.715458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.715629] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.722393] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9 with status ACTIVE [ 648.722744] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.722744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.723054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.723113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.723164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.723342] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.723445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.723505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.723650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.723727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.723905] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.724022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.724082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.724208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.724280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.724364] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9 is going to be updated. [ 648.756840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.757085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.757142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.757362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.757546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.757712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe9ffd56-93d7-4890-9c1f-e5049dc1d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.146760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 649.147189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.224649] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.241643] env[66157]: INFO networking_nsxv3.common.synchronization [req-8f0a9351-9ff1-49d9-b95a-d6b8512747be req-cf7c0a3b-7a83-4450-a33a-a0ae178a7398 tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 649.242337] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 649.242648] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.244464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.244559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.244810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.245198] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.245198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.245198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.245363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.245363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.246655] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.728092] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.728092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.728092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.728092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.728092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.728092] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c792349-7376-489a-b7da-3c608db236ad is going to be created. [ 649.747811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.748108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.748108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.749046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.749046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.749046] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.749046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.749046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.749046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.749046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.749551] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef already deleted. [ 649.749551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.760321] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.760702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.760702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.760770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.761105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.774794] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c792349-7376-489a-b7da-3c608db236ad in Status: UNINITIALIZED for 2s [ 649.828109] env[66157]: INFO networking_nsxv3.common.synchronization [None req-d091fc09-7018-4edd-a1c8-177b5e4fb304 None None] Enqueued Resource ID: b5328792-7dab-45bf-b37b-aba199c7e442 with Priority: HIGHEST for action port [ 649.829446] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5328792-7dab-45bf-b37b-aba199c7e442 with Priority: HIGHEST for action port [ 649.829446] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5328792-7dab-45bf-b37b-aba199c7e442 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.829712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5328792-7dab-45bf-b37b-aba199c7e442" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.829712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5328792-7dab-45bf-b37b-aba199c7e442" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.831021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5328792-7dab-45bf-b37b-aba199c7e442" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.831021] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5328792-7dab-45bf-b37b-aba199c7e442',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.958045] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.958397] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.958397] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.958814] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.958906] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.959844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.959844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.959844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.959844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.960359] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.960891] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.960891] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.960891] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.961183] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.961364] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.961604] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.983376] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.983587] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.983766] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.984086] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.984459] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.984586] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.984687] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.984998] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.985148] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f90f623-e4ba-4b7e-8daf-e5412edc24ff',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.333271] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5328792-7dab-45bf-b37b-aba199c7e442 [ 650.335112] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.335112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.335112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.335112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.335112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.335112] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5328792-7dab-45bf-b37b-aba199c7e442 already deleted. [ 650.335112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5328792-7dab-45bf-b37b-aba199c7e442" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.488121] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.488379] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.488504] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.488819] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.488937] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.489126] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 2f90f623-e4ba-4b7e-8daf-e5412edc24ff not found, creating... [ 650.489415] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.489569] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.489681] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.489893] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.490040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.490310] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.490458] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.490569] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.490768] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.490920] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.491130] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 2f90f623-e4ba-4b7e-8daf-e5412edc24ff is going to be created. [ 650.514710] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.514710] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.514710] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.515348] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.515348] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.515527] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.637474] env[66157]: INFO networking_nsxv3.common.synchronization [req-8f0a9351-9ff1-49d9-b95a-d6b8512747be req-1a691526-7deb-431a-8b6c-9427bff8aeed service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 651.637731] env[66157]: INFO networking_nsxv3.common.synchronization [req-8f0a9351-9ff1-49d9-b95a-d6b8512747be req-1a691526-7deb-431a-8b6c-9427bff8aeed service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 651.637731] env[66157]: INFO networking_nsxv3.common.synchronization [req-8f0a9351-9ff1-49d9-b95a-d6b8512747be req-1a691526-7deb-431a-8b6c-9427bff8aeed service nova] Enqueued Resource ID: 2f90f623-e4ba-4b7e-8daf-e5412edc24ff with Priority: HIGHEST for action port [ 651.638443] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 651.639211] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 651.639341] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f90f623-e4ba-4b7e-8daf-e5412edc24ff with Priority: HIGHEST for action port [ 651.639635] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.639749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.639811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.640795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.640795] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.641319] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.643381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.643381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.643381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.643381] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.643381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.643381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.643381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.643381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.643763] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.646306] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.646479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.646479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.647170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.647170] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f90f623-e4ba-4b7e-8daf-e5412edc24ff',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.785987] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c792349-7376-489a-b7da-3c608db236ad in Status: SUCCESS [ 651.786252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.786994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.787357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.787547] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.787693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.787788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.788214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.788342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.788433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.788538] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.953820] env[66157]: INFO networking_nsxv3.common.synchronization [None req-b534ef8f-d6a6-479b-ab83-256658c3c90f None None] Enqueued Resource ID: ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce with Priority: HIGHEST for action port [ 651.953820] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce with Priority: HIGHEST for action port [ 651.953820] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.953820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.953820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.954654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.954654] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.035048] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-73e32885-fff7-44b0-8fce-16e73b5eef7b tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 652.035658] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 652.035977] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.036221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.036280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.036548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.036676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.036777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.036839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.036994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.037114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.037249] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.110284] env[66157]: INFO networking_nsxv3.common.synchronization [None req-48918d01-cde4-48a5-9d86-66bb37b79f6f None None] Enqueued Resource ID: 25115f2b-358f-44f9-85b7-57787167cb20 with Priority: HIGHEST for action port [ 652.112405] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25115f2b-358f-44f9-85b7-57787167cb20 with Priority: HIGHEST for action port [ 652.113210] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-25115f2b-358f-44f9-85b7-57787167cb20 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.113349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25115f2b-358f-44f9-85b7-57787167cb20" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.113408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25115f2b-358f-44f9-85b7-57787167cb20" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.113677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25115f2b-358f-44f9-85b7-57787167cb20" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.113782] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25115f2b-358f-44f9-85b7-57787167cb20',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.147651] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.149109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.149195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.150078] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f90f623-e4ba-4b7e-8daf-e5412edc24ff with status ACTIVE [ 652.150078] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.150078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.150078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.150078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.150078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.150078] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.150365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.150365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.150365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.150446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.151576] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.151576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.151576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.151576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.151576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.151576] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f90f623-e4ba-4b7e-8daf-e5412edc24ff is going to be updated. [ 652.176777] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.177039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.177102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.177396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.177599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.177806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f90f623-e4ba-4b7e-8daf-e5412edc24ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.291735] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c792349-7376-489a-b7da-3c608db236ad taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.291964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.291964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.292324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.292428] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.292524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.292524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.292637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.292722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.292810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.293110] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c792349-7376-489a-b7da-3c608db236ad taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.293218] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.293404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.293466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.293573] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.293658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.293722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.293856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.294037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.294071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.294816] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.458101] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce [ 652.458355] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.458520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.458602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.458828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.458918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.459023] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce already deleted. [ 652.459134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffe5f21e-6347-421f-90d8-9a5f9f1ef6ce" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.544955] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.545124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.545416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.545508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.545653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.545749] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.545846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.545918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.546058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.546262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.546262] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 already deleted. [ 652.546413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.619685] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25115f2b-358f-44f9-85b7-57787167cb20 [ 652.619685] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.619685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.619685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.619685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.619685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.619685] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25115f2b-358f-44f9-85b7-57787167cb20 already deleted. [ 652.619685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25115f2b-358f-44f9-85b7-57787167cb20" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.652970] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.797308] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c792349-7376-489a-b7da-3c608db236ad: rpc.has_security_group_logging(os_id): False [ 652.839614] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-a6ffc0b2-4d91-4588-9095-694b3a01d68c tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 652.839844] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 652.840665] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.840665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.840665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.840895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.843961] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.843961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.843961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.845165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.845165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.845345] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.863650] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.863881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.864027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.864857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.865677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.865677] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.865677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.865861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.866013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.866192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.866555] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.866731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.866843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.867116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.867719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.868134] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.868332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.868544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.868808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.868949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.869101] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c792349-7376-489a-b7da-3c608db236ad is going to be created. [ 652.966022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.966022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.966288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.966633] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.966845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.980602] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c792349-7376-489a-b7da-3c608db236ad in Status: IN_PROGRESS for 2s [ 653.158629] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.158891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.159265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.159627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.159783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.159948] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be created. [ 653.187135] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.187319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.187319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.187529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.187691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.200201] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: UNINITIALIZED for 2s [ 653.351041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.351327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.351327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.351541] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.351634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.351833] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.351934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.351998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.352183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.352251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.352337] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 already deleted. [ 653.352415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.711029] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-b6977605-4f23-4f68-80ec-bdb80e64dd7a tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 653.711540] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 653.711844] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.713016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.713721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.714068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.714398] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.714626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.714845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.715167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.715597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.715795] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.007864] env[66157]: INFO networking_nsxv3.common.synchronization [req-2b94a749-78cf-45be-98bb-dc4dc6836430 req-b4d5b647-7716-4f7a-82dc-53715c789a8d tempest-ServersAdminTestJSON-1739826864 tempest-ServersAdminTestJSON-1739826864-project-member] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 654.007864] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 654.009670] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.010752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.012032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.012032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.012032] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.012032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.012032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.012032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.012032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.014015] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.222598] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.222858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.223155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.223481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.223598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.223878] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.224023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.224110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.224964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.225664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.225664] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 already deleted. [ 654.225664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.290450] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f7bd0389-004a-46a8-ba5e-eba295a15697 None None] Enqueued Resource ID: 8e4bdc9b-b2dd-49da-bcde-40bef646b50c with Priority: HIGHEST for action port [ 654.295648] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e4bdc9b-b2dd-49da-bcde-40bef646b50c with Priority: HIGHEST for action port [ 654.296910] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e4bdc9b-b2dd-49da-bcde-40bef646b50c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.297201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e4bdc9b-b2dd-49da-bcde-40bef646b50c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.297253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e4bdc9b-b2dd-49da-bcde-40bef646b50c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.297591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e4bdc9b-b2dd-49da-bcde-40bef646b50c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.297715] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e4bdc9b-b2dd-49da-bcde-40bef646b50c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.413129] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-22 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.413129] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-22" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.413287] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-22" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.413575] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-22" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.413834] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.414030] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.414697] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.414941] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.415112] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.415318] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.415428] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.415532] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.415636] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.415739] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.415839] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.415964] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.440565] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.440760] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.441028] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.442660] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-22" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.442660] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.442660] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.443119] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.443751] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.443970] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3104a2f7-4cea-4c63-a4fa-f7f1d2935477',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.515049] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.515289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.515377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.515668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.515784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.516026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.516157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.516432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.516432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.516533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.516590] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 already deleted. [ 654.516675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.800012] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e4bdc9b-b2dd-49da-bcde-40bef646b50c [ 654.800284] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.800436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.800492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.800697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.800788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.800895] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e4bdc9b-b2dd-49da-bcde-40bef646b50c already deleted. [ 654.800984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e4bdc9b-b2dd-49da-bcde-40bef646b50c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.849046] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.849446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.849446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.849671] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.849910] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.850076] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.850204] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.850384] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.850520] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.850711] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.850821] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.850928] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.851056] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.851168] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.851267] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.851411] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.870708] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.870905] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.871145] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.871324] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.871627] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-6ba3538f-b678-4879-b7d0-b8677932c15d taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.871796] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-6ba3538f-b678-4879-b7d0-b8677932c15d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.871907] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-6ba3538f-b678-4879-b7d0-b8677932c15d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.872234] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-6ba3538f-b678-4879-b7d0-b8677932c15d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.872368] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba3538f-b678-4879-b7d0-b8677932c15d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.946777] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.946997] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.947097] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.947384] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.947535] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.947678] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 3104a2f7-4cea-4c63-a4fa-f7f1d2935477 not found, creating... [ 654.947933] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.948130] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.948250] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.948459] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.948592] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.948877] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.949046] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.949165] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.949342] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.949506] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.949644] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 3104a2f7-4cea-4c63-a4fa-f7f1d2935477 is going to be created. [ 654.971487] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.971747] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.971870] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.972179] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.972442] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.972690] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.996045] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c792349-7376-489a-b7da-3c608db236ad in Status: SUCCESS [ 654.996232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.211588] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 655.211588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.211588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.211912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.211955] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.212080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.212146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.212298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.212381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.212465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.212556] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.375722] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.376280] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.376479] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.376756] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.376906] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.377100] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 6ba3538f-b678-4879-b7d0-b8677932c15d not found, creating... [ 655.377367] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.377528] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.377654] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.377856] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.378043] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.378337] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.378483] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.378623] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.378795] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.378927] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.379081] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 6ba3538f-b678-4879-b7d0-b8677932c15d is going to be created. [ 655.403339] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.403591] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.403669] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.403905] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.404199] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.404422] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-6ba3538f-b678-4879-b7d0-b8677932c15d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.715073] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.715073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.715269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.715391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.715557] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.715663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.715814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.715878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.715949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.716050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.716342] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.716453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.716524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.716648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.716785] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.716876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.716946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.717090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.717201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.717339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.717461] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.739728] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-b2d89ffc-c3ca-44dc-9520-4d8cedcf9fd7 service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 655.739900] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-b2d89ffc-c3ca-44dc-9520-4d8cedcf9fd7 service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 655.740049] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-b2d89ffc-c3ca-44dc-9520-4d8cedcf9fd7 service nova] Enqueued Resource ID: 3104a2f7-4cea-4c63-a4fa-f7f1d2935477 with Priority: HIGHEST for action port [ 655.740681] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 655.740681] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 655.740681] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3104a2f7-4cea-4c63-a4fa-f7f1d2935477 with Priority: HIGHEST for action port [ 655.741219] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.741344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.741408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.741664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.741742] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.742564] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.742678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.742745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.742908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.743140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.743239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.743300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.743443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.743529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.743617] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.747074] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.747074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.747074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.747074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.747074] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3104a2f7-4cea-4c63-a4fa-f7f1d2935477',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.136168] env[66157]: INFO networking_nsxv3.common.synchronization [req-2b94a749-78cf-45be-98bb-dc4dc6836430 req-9866152c-6678-4c3e-bc6f-6bc1f903042f service nova] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_rules [ 656.136451] env[66157]: INFO networking_nsxv3.common.synchronization [req-2b94a749-78cf-45be-98bb-dc4dc6836430 req-9866152c-6678-4c3e-bc6f-6bc1f903042f service nova] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 656.136506] env[66157]: INFO networking_nsxv3.common.synchronization [req-2b94a749-78cf-45be-98bb-dc4dc6836430 req-9866152c-6678-4c3e-bc6f-6bc1f903042f service nova] Enqueued Resource ID: 6ba3538f-b678-4879-b7d0-b8677932c15d with Priority: HIGHEST for action port [ 656.137038] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_rules [ 656.137184] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 656.137286] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba3538f-b678-4879-b7d0-b8677932c15d with Priority: HIGHEST for action port [ 656.137563] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.137691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.137763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.138175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.138175] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.139048] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.139174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.139343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.139706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.139876] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.139967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.140056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.140242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.140310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.140404] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.142794] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ba3538f-b678-4879-b7d0-b8677932c15d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.142919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ba3538f-b678-4879-b7d0-b8677932c15d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.143060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ba3538f-b678-4879-b7d0-b8677932c15d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.143236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ba3538f-b678-4879-b7d0-b8677932c15d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.143313] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba3538f-b678-4879-b7d0-b8677932c15d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.220240] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4915dbf-d6e2-46dd-8508-11f50b8da0ef: rpc.has_security_group_logging(os_id): False [ 656.239815] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.239986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.240054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.240235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.240324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.240566] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.240668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.240735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.240925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.241045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.241247] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.241363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.241441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.241605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.241703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.241939] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.242069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.242139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.242298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.242765] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.242765] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be created. [ 656.246815] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.248022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.248143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.248349] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3104a2f7-4cea-4c63-a4fa-f7f1d2935477 with status ACTIVE [ 656.248445] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.248574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.248661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.248906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.249083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.249382] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.249382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.249580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.249580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.249689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.249898] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.250018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.252026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.252026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.252026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.252026] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3104a2f7-4cea-4c63-a4fa-f7f1d2935477 is going to be updated. [ 656.275230] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.275474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.275474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.276034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.276034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.276034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3104a2f7-4cea-4c63-a4fa-f7f1d2935477" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.310406] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.310598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.310644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.310939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.311099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.330334] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 656.646249] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.646486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.647108] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.647554] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ba3538f-b678-4879-b7d0-b8677932c15d with status ACTIVE [ 656.647771] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.647891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.647968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.648217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.648314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.648503] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.648590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.648691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.650931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.651055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.651426] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.651426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.651426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.651584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.651685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.651778] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ba3538f-b678-4879-b7d0-b8677932c15d is going to be updated. [ 656.684098] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.684098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.684098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.684098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.684098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.684098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ba3538f-b678-4879-b7d0-b8677932c15d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.754188] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.763524] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.763524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-913" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.763781] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-913" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.764081] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-913" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.764451] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.765292] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.765292] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.765292] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.765461] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.765720] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.765872] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.766068] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.766259] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.766413] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.766585] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.767867] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.787399] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.787572] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.787707] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.787879] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-913" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.788211] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.788384] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.788499] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.788871] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.789010] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a62ee78-b907-4612-b4ca-3f9abe08a4e6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.154609] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.257625] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.257839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.257967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.258339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.258517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.258650] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be created. [ 657.287621] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.287892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.287958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.288257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.288489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.292305] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.292556] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.292718] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.293150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.293346] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.293566] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 7a62ee78-b907-4612-b4ca-3f9abe08a4e6 not found, creating... [ 657.293968] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.294215] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.294381] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.294691] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.294887] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.295327] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.295533] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.295698] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.295986] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.296231] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.296404] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 7a62ee78-b907-4612-b4ca-3f9abe08a4e6 is going to be created. [ 657.300566] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: UNINITIALIZED for 2s [ 657.337701] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.337701] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.337701] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.337701] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.338084] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.338253] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.659475] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.659475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.659475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.659475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.659475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.659475] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be created. [ 657.689321] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.689585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.689585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.691237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.691237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.707768] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: UNINITIALIZED for 2s [ 658.013488] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-37b95288-d0c5-4f06-baa5-7a589b9f76e6 service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 658.013712] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-37b95288-d0c5-4f06-baa5-7a589b9f76e6 service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 658.014017] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-37b95288-d0c5-4f06-baa5-7a589b9f76e6 service nova] Enqueued Resource ID: 7a62ee78-b907-4612-b4ca-3f9abe08a4e6 with Priority: HIGHEST for action port [ 658.014627] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 658.014627] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 658.014627] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a62ee78-b907-4612-b4ca-3f9abe08a4e6 with Priority: HIGHEST for action port [ 658.014979] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.015270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.015373] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.015568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.015940] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.015940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.016138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.016172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.017707] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a62ee78-b907-4612-b4ca-3f9abe08a4e6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.126640] env[66157]: INFO networking_nsxv3.common.synchronization [None req-8c3ff7c0-47bd-4124-9f08-0ee5ff669c52 None None] Enqueued Resource ID: f646d43f-96ca-463e-bdad-b207560c5682 with Priority: HIGHEST for action port [ 658.127449] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f646d43f-96ca-463e-bdad-b207560c5682 with Priority: HIGHEST for action port [ 658.127790] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-f646d43f-96ca-463e-bdad-b207560c5682 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.127956] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f646d43f-96ca-463e-bdad-b207560c5682" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.128135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f646d43f-96ca-463e-bdad-b207560c5682" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.128461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f646d43f-96ca-463e-bdad-b207560c5682" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.128569] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f646d43f-96ca-463e-bdad-b207560c5682',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.345619] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 658.346091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.522083] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a62ee78-b907-4612-b4ca-3f9abe08a4e6 with status ACTIVE [ 658.522083] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.522083] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.522083] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.522083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.522083] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a62ee78-b907-4612-b4ca-3f9abe08a4e6 is going to be updated. [ 658.545430] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.545654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.545746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.546038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.546204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.546426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a62ee78-b907-4612-b4ca-3f9abe08a4e6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.550414] env[66157]: INFO networking_nsxv3.common.synchronization [req-648e6c66-0455-444b-9278-38cb48731aff req-28847b76-50b0-4a29-b6aa-8931f00fc57f tempest-ServersAdminTestJSON-1739826864 tempest-ServersAdminTestJSON-1739826864-project-member] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 658.550414] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 658.550414] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.550414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.631605] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f646d43f-96ca-463e-bdad-b207560c5682 [ 658.631605] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.631605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.631605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.631605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.631605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.631605] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f646d43f-96ca-463e-bdad-b207560c5682 already deleted. [ 658.631605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f646d43f-96ca-463e-bdad-b207560c5682" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.865797] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-22 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.865797] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-22" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.865948] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-22" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.866239] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-22" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.866504] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.866663] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.866776] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.866990] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.867259] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.867477] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.867590] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.867696] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.867801] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.867904] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.868013] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.868144] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.887216] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.887351] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.887546] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.887766] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-22" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.888107] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-af887a36-cf75-477e-82ba-35a07880085e taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.888281] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-af887a36-cf75-477e-82ba-35a07880085e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.888398] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-af887a36-cf75-477e-82ba-35a07880085e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.888837] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-af887a36-cf75-477e-82ba-35a07880085e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.888923] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af887a36-cf75-477e-82ba-35a07880085e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.965717] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.966060] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.966242] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.966600] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.966980] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.967277] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.967430] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.967746] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.967921] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.968242] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.968432] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.968562] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.968669] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.968781] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.968893] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.969022] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.989414] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.989605] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.989740] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.989912] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.990285] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-faeebc9b-d343-4fae-b4d2-8da423394882 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.990426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-faeebc9b-d343-4fae-b4d2-8da423394882" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.990602] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-faeebc9b-d343-4fae-b4d2-8da423394882" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.990990] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-faeebc9b-d343-4fae-b4d2-8da423394882" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.991068] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faeebc9b-d343-4fae-b4d2-8da423394882',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.317224] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 659.317396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.317792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.317792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.317964] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.318104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.318273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.318429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.318540] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.318636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.318800] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.319764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.320579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.320579] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.320579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.320579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.320579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.320579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.320923] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.391721] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.392092] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.392159] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.392506] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.392675] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.392882] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port af887a36-cf75-477e-82ba-35a07880085e not found, creating... [ 659.393372] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.393547] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.393667] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.393916] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.394189] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.394716] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.395018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.395200] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.395567] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.395711] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.395902] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: af887a36-cf75-477e-82ba-35a07880085e is going to be created. [ 659.422611] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.422807] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.422937] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.423268] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.423494] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.423712] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-af887a36-cf75-477e-82ba-35a07880085e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.493369] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.493590] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.493710] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.494031] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.494196] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.494300] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port faeebc9b-d343-4fae-b4d2-8da423394882 not found, creating... [ 659.494557] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.494706] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.494815] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.495039] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.495171] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.495473] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.495676] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.495739] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.495922] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.496058] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.496195] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: faeebc9b-d343-4fae-b4d2-8da423394882 is going to be created. [ 659.542461] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.542724] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.542792] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.543150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.543410] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.543860] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-faeebc9b-d343-4fae-b4d2-8da423394882" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.718912] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 659.719262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.719416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.719627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.719813] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.719931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.720033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.720203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.720346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.720448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.720583] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.721564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.721756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.721989] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.722116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.722183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.722333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.722411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.722516] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.822884] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.823082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.823290] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.133822] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-64f6bf88-fbfb-4691-824e-c1043901de23 service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 660.133822] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-64f6bf88-fbfb-4691-824e-c1043901de23 service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 660.133822] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf0ea9d4-2a91-417f-bbf6-6916af44bd10 req-64f6bf88-fbfb-4691-824e-c1043901de23 service nova] Enqueued Resource ID: af887a36-cf75-477e-82ba-35a07880085e with Priority: HIGHEST for action port [ 660.136080] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 660.136080] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 660.136080] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af887a36-cf75-477e-82ba-35a07880085e with Priority: HIGHEST for action port [ 660.136080] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.136240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.136463] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.136566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.136780] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-af887a36-cf75-477e-82ba-35a07880085e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.136880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af887a36-cf75-477e-82ba-35a07880085e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.136953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af887a36-cf75-477e-82ba-35a07880085e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.137226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af887a36-cf75-477e-82ba-35a07880085e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.137308] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af887a36-cf75-477e-82ba-35a07880085e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.224730] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.224883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.225059] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.277369] env[66157]: INFO networking_nsxv3.common.synchronization [req-648e6c66-0455-444b-9278-38cb48731aff req-af0606c6-50b0-4982-97ad-13ea5a0587a4 service nova] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_rules [ 660.277543] env[66157]: INFO networking_nsxv3.common.synchronization [req-648e6c66-0455-444b-9278-38cb48731aff req-af0606c6-50b0-4982-97ad-13ea5a0587a4 service nova] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 660.277676] env[66157]: INFO networking_nsxv3.common.synchronization [req-648e6c66-0455-444b-9278-38cb48731aff req-af0606c6-50b0-4982-97ad-13ea5a0587a4 service nova] Enqueued Resource ID: faeebc9b-d343-4fae-b4d2-8da423394882 with Priority: HIGHEST for action port [ 660.279161] env[66157]: INFO networking_nsxv3.common.synchronization [None req-745931ec-ba78-437b-8dd5-16be03af6684 None None] Enqueued Resource ID: a3615fba-bc9f-446b-8d0e-b131debccefa with Priority: HIGHEST for action port [ 660.279388] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_rules [ 660.279719] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faeebc9b-d343-4fae-b4d2-8da423394882 with Priority: HIGHEST for action port [ 660.279856] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 660.279940] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3615fba-bc9f-446b-8d0e-b131debccefa with Priority: HIGHEST for action port [ 660.280491] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.280590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.280966] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-faeebc9b-d343-4fae-b4d2-8da423394882 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.281125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faeebc9b-d343-4fae-b4d2-8da423394882" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.281230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faeebc9b-d343-4fae-b4d2-8da423394882" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.281340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faeebc9b-d343-4fae-b4d2-8da423394882" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.281424] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faeebc9b-d343-4fae-b4d2-8da423394882',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.282434] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.282527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.286049] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3615fba-bc9f-446b-8d0e-b131debccefa taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.286049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3615fba-bc9f-446b-8d0e-b131debccefa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.286049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3615fba-bc9f-446b-8d0e-b131debccefa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.286049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3615fba-bc9f-446b-8d0e-b131debccefa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.286049] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3615fba-bc9f-446b-8d0e-b131debccefa',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.326653] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.641446] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af887a36-cf75-477e-82ba-35a07880085e with status ACTIVE [ 660.641446] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.641446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.641446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.641874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.641874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.641874] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.641985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.642094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.642224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.642305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.642520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.644020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.644020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.645773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.645877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.645980] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af887a36-cf75-477e-82ba-35a07880085e is going to be updated. [ 660.671040] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.672120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.672120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.672285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.672838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.672838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af887a36-cf75-477e-82ba-35a07880085e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.727929] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.785105] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port faeebc9b-d343-4fae-b4d2-8da423394882 with status ACTIVE [ 660.787306] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.787306] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.787306] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.787306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.787306] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: faeebc9b-d343-4fae-b4d2-8da423394882 is going to be updated. [ 660.789174] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3615fba-bc9f-446b-8d0e-b131debccefa [ 660.790457] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.790457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.790457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.790457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.790457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.790457] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3615fba-bc9f-446b-8d0e-b131debccefa already deleted. [ 660.791074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3615fba-bc9f-446b-8d0e-b131debccefa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.823116] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.823116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.823116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.823116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.823116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.823621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faeebc9b-d343-4fae-b4d2-8da423394882" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.829054] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.829251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.829296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.829530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.829574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.829677] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 660.899907] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.900079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.900136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.900349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.900499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.921031] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 661.230019] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.230238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.230320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.230602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.230786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.230895] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 661.263564] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.263966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.264613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.264613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.264789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.279870] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 662.934199] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 662.934524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.934640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.934848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.935039] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.935240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.935240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.935447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.935447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.935535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.935637] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.935718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.935768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.935909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.936058] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.936150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.936212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.936745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.936745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.936745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.936745] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.940783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.941145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.941235] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.941354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.941387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.941527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.941616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.941710] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.290541] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 663.290769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.291069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.291308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.291504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.291624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.291689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.291843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.291928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.292030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.292202] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.292288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.292364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.296183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.296183] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.296183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.297915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.297915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.297915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.297915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.297915] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.297915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.297915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.300509] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.300509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.300509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.300509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.300509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.300509] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.379708] env[66157]: INFO networking_nsxv3.common.synchronization [None req-50561ae1-8417-4539-9645-6f58481732e8 tempest-ServersTestManualDisk-850948594 tempest-ServersTestManualDisk-850948594-project-member] Enqueued Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_rules [ 663.381251] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_rules [ 663.381251] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3dca9267-bc95-42c2-accb-8a02b78bd970 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.381251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.381683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.381683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.382401] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.441980] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68270d8f-ab80-474f-8966-489611b2e965: rpc.has_security_group_logging(os_id): False [ 663.443966] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.462932] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.463642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.463642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.463642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.463642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.464666] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.464666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.464666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.464666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.464666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.464666] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.464666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.464666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.465193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.465193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.465193] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.466579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.468687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.468687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.468687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.468687] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be created. [ 663.537280] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.537280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.537280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.537280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.537280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.556284] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 663.561174] env[66157]: INFO networking_nsxv3.common.synchronization [None req-b524322a-dd09-42db-bee9-73d25ce00c50 tempest-ServersTestManualDisk-850948594 tempest-ServersTestManualDisk-850948594-project-member] Enqueued Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_rules [ 663.562787] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_rules [ 663.563248] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3dca9267-bc95-42c2-accb-8a02b78bd970 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.563248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.800047] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 222383c0-b19b-4725-af40-286f27465c68: rpc.has_security_group_logging(os_id): False [ 663.801798] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.834457] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.834636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.834701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.835015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.835183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.835495] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.835659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.835768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.836022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.836679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.837000] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.837192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.837365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.837651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.838021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.838358] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.838504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.838588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.838747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.839291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.839457] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be created. [ 663.917676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.917932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.917969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.918227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.918338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.918432] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 already deleted. [ 663.918675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.918675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.918880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.918944] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.940298] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.940752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.940752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.940752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.940966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.947020] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.957199] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 664.307029] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.447578] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.447578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.447578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.447578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.447578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.447578] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 already deleted. [ 664.447578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.450116] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.450259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.450338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.450533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.450620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.450720] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 664.486610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.486843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.487084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.487333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.487440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.499637] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 664.809894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.810427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.810427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.810427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.810427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.810427] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 664.846041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.846041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.846041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.846041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.846485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.860601] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 665.300458] env[66157]: INFO networking_nsxv3.common.synchronization [req-0297aab7-47ff-41f3-99f0-a64a066d0b80 req-229205d5-aabe-40e0-bc08-b5523421dd04 tempest-DeleteServersAdminTestJSON-322000871 tempest-DeleteServersAdminTestJSON-322000871-project-admin] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 665.301406] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 665.303138] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.303138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.303138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.303726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.303912] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.304045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.304121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.304375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.304466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.304565] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.576395] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 665.576395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.576395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.576395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.576395] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.809999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.810278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.810278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.811282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.811381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.812210] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.812210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.812210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.812210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.812210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.812210] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 is going to be updated. [ 665.842718] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.842935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.842935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.843817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.843817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.854695] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: IN_PROGRESS for 2s [ 665.974342] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 665.974916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.974916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.975568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.975568] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.081329] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.081503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.478186] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.478716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.512463] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 666.512710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.513342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.513613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.513848] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.513961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.514038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.514239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.514316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.514400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.514496] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.877051] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 666.877411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.877911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.877911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.878138] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.878276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.878384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.878572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.878688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.878868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.878934] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.016948] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.017231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.017231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.017431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.017612] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.017710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.017866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.017933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.017987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.018923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.018923] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.018923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.018923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.018923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.018923] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.018923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.018923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.018923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.018923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.019675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.019675] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.251332] env[66157]: INFO networking_nsxv3.common.synchronization [req-a0486a0e-64df-428d-8726-e381cb5175ce req-87c49635-2464-45a3-a056-c4dbe1b62f5c tempest-ServerDiagnosticsNegativeTest-1765692284 tempest-ServerDiagnosticsNegativeTest-1765692284-project-member] Enqueued Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGHEST for action security_group_members [ 667.252135] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGHEST for action security_group_members [ 667.252718] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06552dc4-54b0-463a-af1a-33bc39af0c0c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.252718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.252718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.252985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.253127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.253223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.253279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.253472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.253562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.253663] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.381846] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.382219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.382219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.382410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.382647] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.382806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.382896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.383090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.383300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.383509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.383646] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.383758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.383854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.384062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.384217] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.384359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.384459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.384669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.384813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.384897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.385069] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.521997] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68270d8f-ab80-474f-8966-489611b2e965: rpc.has_security_group_logging(os_id): False [ 667.544085] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.544278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.544358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.544546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.544631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.544845] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.544962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.545038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.545189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.545269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.545490] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.545629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.545944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.545944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.545944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.546206] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.546331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.546388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.546543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.546637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.546710] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 667.586362] env[66157]: INFO networking_nsxv3.common.synchronization [req-b866e50a-cb7a-43d3-8681-2ec2e4b291fa req-5b9d9372-c0e6-4fb6-bb67-2ea2a5912771 tempest-ServerDiagnosticsTest-1247298712 tempest-ServerDiagnosticsTest-1247298712-project-member] Enqueued Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGHEST for action security_group_members [ 667.587066] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGHEST for action security_group_members [ 667.587490] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b02819-f659-4343-b709-2e63116c5829 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.587675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.587778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.588060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.588284] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.588432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.588521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.588736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.588856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.588985] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.619041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.619286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.619423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.619579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.619830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.634791] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 667.756682] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.756882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.756882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.757123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.757286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.757523] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.757636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.757714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.757990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.758097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.758197] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c is going to be updated. [ 667.787576] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.787882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.787882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.788144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.788252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.797923] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c in Status: IN_PROGRESS for 2s [ 667.866344] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: SUCCESS [ 667.866651] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 deletion is rescheduled due to dependency. [ 667.866820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.891774] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 222383c0-b19b-4725-af40-286f27465c68: rpc.has_security_group_logging(os_id): False [ 667.913779] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.913970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.914055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.914283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.914394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.914963] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.914963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.914963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.914963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.915260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.915260] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.915337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.915418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.915614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.915701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.915883] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.915997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.916201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.916367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.916458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.916538] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 668.001261] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.001411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.001525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.001757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.001971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.017346] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 668.092317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.092459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.092942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.092942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.092942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.093312] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.093312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.093312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.093499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.093550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.093704] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b02819-f659-4343-b709-2e63116c5829 is going to be updated. [ 668.130981] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.131179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.131241] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.131490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.131635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.143441] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b02819-f659-4343-b709-2e63116c5829 in Status: IN_PROGRESS for 2s [ 669.273543] env[66157]: INFO networking_nsxv3.common.synchronization [None req-dc389703-8a67-4948-83cd-03995262449f None None] Enqueued Resource ID: 9b9a2627-65bf-4720-8bd0-5abf6de5cef7 with Priority: HIGHEST for action port [ 669.274353] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9a2627-65bf-4720-8bd0-5abf6de5cef7 with Priority: HIGHEST for action port [ 669.274695] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b9a2627-65bf-4720-8bd0-5abf6de5cef7 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.274821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b9a2627-65bf-4720-8bd0-5abf6de5cef7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.274891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b9a2627-65bf-4720-8bd0-5abf6de5cef7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.275163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b9a2627-65bf-4720-8bd0-5abf6de5cef7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.275297] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b9a2627-65bf-4720-8bd0-5abf6de5cef7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.654863] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 669.654863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.654863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.654863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.654863] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.777823] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b9a2627-65bf-4720-8bd0-5abf6de5cef7 [ 669.778119] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.778302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.778392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.778601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.778721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.778838] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b9a2627-65bf-4720-8bd0-5abf6de5cef7 already deleted. [ 669.778930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b9a2627-65bf-4720-8bd0-5abf6de5cef7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.783549] env[66157]: INFO networking_nsxv3.common.synchronization [req-49b09049-8c90-4e4f-a461-b6219148c6dc req-4c4de45d-3839-4f5f-8635-cb16d8adbf7b tempest-TenantUsagesTestJSON-242047630 tempest-TenantUsagesTestJSON-242047630-project-member] Enqueued Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGHEST for action security_group_members [ 669.784162] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGHEST for action security_group_members [ 669.784517] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9050a2e-a60d-4614-aa8f-0f8639b64779 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.784618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.784698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.784881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.785068] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.785178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.785242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.785389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.785519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.785874] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.809245] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c in Status: SUCCESS [ 669.809437] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c deletion is rescheduled due to dependency. [ 669.809518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.931348] env[66157]: INFO networking_nsxv3.common.synchronization [req-de21621c-f25a-477e-abec-34e92da7e5e5 req-d40f3368-7d25-4f72-a5e7-014e9c1e2761 tempest-ServersWithSpecificFlavorTestJSON-563142723 tempest-ServersWithSpecificFlavorTestJSON-563142723-project-member] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 669.931997] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 669.933894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.934055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.934929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.935262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.935530] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.935762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.935831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.936063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.936206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.936336] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.038457] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 670.038686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.160030] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b02819-f659-4343-b709-2e63116c5829 in Status: SUCCESS [ 670.160030] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b02819-f659-4343-b709-2e63116c5829 deletion is rescheduled due to dependency. [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.160030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.160030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.160030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.160030] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.288537] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.289691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.289691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.289884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.289983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.292088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.292088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.292088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.292088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.292088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.292088] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 is going to be updated. [ 670.325861] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.325968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.326060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.326266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.326431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.345598] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 in Status: IN_PROGRESS for 2s [ 670.442070] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.442248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.442322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.442701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.442833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.443487] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.443608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.443678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.443826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.443908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.443999] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f already deleted. [ 670.444096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.448111] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.448111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-921" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.448111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-921" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.448111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-921" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.448111] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.448111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.448111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.448111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.448111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.448111] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.448111] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.448111] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.448111] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.448791] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.448791] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.448791] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.475027] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.475027] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.475027] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.475027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-921" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.475027] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-75196da9-acb2-4c09-acff-bee02f4e9173 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.475027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-75196da9-acb2-4c09-acff-bee02f4e9173" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.475027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-75196da9-acb2-4c09-acff-bee02f4e9173" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.475027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-75196da9-acb2-4c09-acff-bee02f4e9173" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.475027] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75196da9-acb2-4c09-acff-bee02f4e9173',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.662458] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.662623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.662699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.662939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.663115] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.663288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.663356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.663510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.663615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.663935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.663935] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.663935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.664161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.664161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.664434] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.664576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.664576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.664713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.665031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.665031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.665031] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.979208] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.979437] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.979557] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.979880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.980054] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.980207] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 75196da9-acb2-4c09-acff-bee02f4e9173 not found, creating... [ 670.980469] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.980621] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.980733] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.980949] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.981101] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.981398] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.981554] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.981661] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.981857] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.981981] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.982129] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 75196da9-acb2-4c09-acff-bee02f4e9173 is going to be created. [ 671.007268] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.007496] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.007496] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.008398] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.008398] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.008398] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-75196da9-acb2-4c09-acff-bee02f4e9173" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.173362] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68270d8f-ab80-474f-8966-489611b2e965: rpc.has_security_group_logging(os_id): False [ 671.195029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.195029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.195029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.195029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.195659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.195659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.195659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.195659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.195659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.195659] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 671.277497] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.277497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.277756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.277756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.277873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.314731] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 671.734918] env[66157]: INFO networking_nsxv3.common.synchronization [req-de21621c-f25a-477e-abec-34e92da7e5e5 req-46e11919-b73a-4788-afb8-6b983aa2052d service nova] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_rules [ 671.735214] env[66157]: INFO networking_nsxv3.common.synchronization [req-de21621c-f25a-477e-abec-34e92da7e5e5 req-46e11919-b73a-4788-afb8-6b983aa2052d service nova] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 671.735214] env[66157]: INFO networking_nsxv3.common.synchronization [req-de21621c-f25a-477e-abec-34e92da7e5e5 req-46e11919-b73a-4788-afb8-6b983aa2052d service nova] Enqueued Resource ID: 75196da9-acb2-4c09-acff-bee02f4e9173 with Priority: HIGHEST for action port [ 671.736025] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_rules [ 671.736130] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 671.736321] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75196da9-acb2-4c09-acff-bee02f4e9173 with Priority: HIGHEST for action port [ 671.737088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.737306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.737306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.737506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.737600] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.739014] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.739014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.739014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.739014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.739509] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.739509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.739509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.739509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.739509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.739956] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.740632] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-75196da9-acb2-4c09-acff-bee02f4e9173 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.740743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75196da9-acb2-4c09-acff-bee02f4e9173" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.740782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75196da9-acb2-4c09-acff-bee02f4e9173" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.740927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75196da9-acb2-4c09-acff-bee02f4e9173" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.741020] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75196da9-acb2-4c09-acff-bee02f4e9173',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.246197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.246197] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.246197] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75196da9-acb2-4c09-acff-bee02f4e9173 with status ACTIVE [ 672.246197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.246197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.246197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.246822] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.246822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.247175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.247531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.247714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.247963] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75196da9-acb2-4c09-acff-bee02f4e9173 is going to be updated. [ 672.278485] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.278485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.278485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.278485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.278683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.278844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75196da9-acb2-4c09-acff-bee02f4e9173" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.351839] env[66157]: INFO networking_nsxv3.common.synchronization [req-25ebce85-2294-4e6a-9a08-2a807b56e177 req-2ef7653f-b1f3-4a22-8597-494db903d9dd tempest-ServerRescueTestJSON-1845946177 tempest-ServerRescueTestJSON-1845946177-project-member] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 672.353452] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 672.353881] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.354028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.354133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.354465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.354644] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.354767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.354846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.355026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.355142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.355244] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.360897] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 in Status: SUCCESS [ 672.361277] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 deletion is rescheduled due to dependency. [ 672.361405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.751588] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.859475] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.859888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.860234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.860503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.860603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.860838] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.860941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.861122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.864129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.864129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.864129] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 already deleted. [ 672.864129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.940034] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-6 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.940034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.940034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.940034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.940034] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.940034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.940034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.940034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.940034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.940034] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.940034] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.940034] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.940034] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.940791] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.940791] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.940791] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.993934] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.993934] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.053 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.993934] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.994222] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.994485] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-7e80ed35-3629-43a8-bfb3-a1990896fd54 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.994718] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-7e80ed35-3629-43a8-bfb3-a1990896fd54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.994876] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-7e80ed35-3629-43a8-bfb3-a1990896fd54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.995593] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-7e80ed35-3629-43a8-bfb3-a1990896fd54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.995731] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e80ed35-3629-43a8-bfb3-a1990896fd54',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.255289] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.255289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.255289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.255596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.255596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.255735] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be created. [ 673.282801] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.283105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.283105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.283233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.283421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.294123] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: UNINITIALIZED for 2s [ 673.329899] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 673.330148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.498763] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.499150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.499216] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.499478] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.499639] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.499807] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 7e80ed35-3629-43a8-bfb3-a1990896fd54 not found, creating... [ 673.500139] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.500304] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.500417] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.500646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.500773] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.501060] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.501238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.501355] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.501582] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.501720] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.501853] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 7e80ed35-3629-43a8-bfb3-a1990896fd54 is going to be created. [ 673.522286] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.522286] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.522438] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.522628] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.522855] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.523100] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-7e80ed35-3629-43a8-bfb3-a1990896fd54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.219138] env[66157]: INFO networking_nsxv3.common.synchronization [req-25ebce85-2294-4e6a-9a08-2a807b56e177 req-3aa674bf-b7bb-4824-8b61-6678f7c1486a service nova] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_rules [ 674.219298] env[66157]: INFO networking_nsxv3.common.synchronization [req-25ebce85-2294-4e6a-9a08-2a807b56e177 req-3aa674bf-b7bb-4824-8b61-6678f7c1486a service nova] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 674.219442] env[66157]: INFO networking_nsxv3.common.synchronization [req-25ebce85-2294-4e6a-9a08-2a807b56e177 req-3aa674bf-b7bb-4824-8b61-6678f7c1486a service nova] Enqueued Resource ID: 7e80ed35-3629-43a8-bfb3-a1990896fd54 with Priority: HIGHEST for action port [ 674.220315] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_rules [ 674.220425] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 674.220526] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e80ed35-3629-43a8-bfb3-a1990896fd54 with Priority: HIGHEST for action port [ 674.220806] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.220991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.221103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.221482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.221581] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.222554] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.222663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.222721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.222896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.223049] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.223144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.223208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.223382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.223469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.223602] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.224370] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e80ed35-3629-43a8-bfb3-a1990896fd54 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.224476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e80ed35-3629-43a8-bfb3-a1990896fd54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.224563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e80ed35-3629-43a8-bfb3-a1990896fd54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.224718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e80ed35-3629-43a8-bfb3-a1990896fd54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.224792] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e80ed35-3629-43a8-bfb3-a1990896fd54',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.725298] env[66157]: INFO networking_nsxv3.common.synchronization [req-f2e1bf24-897e-4004-9c45-896c8585393a req-77e6ad1e-5bbc-4f55-a96b-b92ccb54281d tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 674.725830] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 674.728074] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.728074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.728074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.728074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.728074] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.728074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.728074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.728074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.728074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.728074] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.732021] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.732021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.732021] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e80ed35-3629-43a8-bfb3-a1990896fd54 with status ACTIVE [ 674.732021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.732021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.732021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.733094] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.733094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.733094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.733094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.733094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.733094] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e80ed35-3629-43a8-bfb3-a1990896fd54 is going to be updated. [ 674.755804] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.755993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.756086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.756390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.756612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.757046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e80ed35-3629-43a8-bfb3-a1990896fd54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.050491] env[66157]: INFO networking_nsxv3.common.synchronization [req-34abc02c-a75f-47a2-b937-e480deaa2a25 req-387aaac7-0d5e-4249-8c16-b9157ece6e88 tempest-ServerExternalEventsTest-1956610848 tempest-ServerExternalEventsTest-1956610848-project-member] Enqueued Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGHEST for action security_group_members [ 675.050791] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGHEST for action security_group_members [ 675.051170] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c792349-7376-489a-b7da-3c608db236ad taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.053062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.053062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.053062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.053062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.053062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.053062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.053062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.053062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.053062] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.231236] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.232983] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.232983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.232983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.232983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.232983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.234081] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.234081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.234081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.234081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.234081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.234081] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b already deleted. [ 675.234081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.304805] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: SUCCESS [ 675.304982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.305120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.305329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.305527] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.305685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.305764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.305944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.306032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.306103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.306193] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.470981] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.470981] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.471326] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.471592] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.471884] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.472089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.472235] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.472460] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.472607] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.472798] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.472941] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.473091] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.473254] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.473427] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.473564] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.473696] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.496946] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.497174] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.497296] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.497566] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.497917] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.498096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.498201] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.498524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.498659] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.550495] env[66157]: INFO networking_nsxv3.common.synchronization [None req-06856332-7761-48eb-b0f8-11babfca8c85 None None] Enqueued Resource ID: 9e4a7e22-07fc-4aa8-b451-854739ccae0f with Priority: HIGHEST for action port [ 675.551030] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e4a7e22-07fc-4aa8-b451-854739ccae0f with Priority: HIGHEST for action port [ 675.551341] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e4a7e22-07fc-4aa8-b451-854739ccae0f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.551461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e4a7e22-07fc-4aa8-b451-854739ccae0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.551529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e4a7e22-07fc-4aa8-b451-854739ccae0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.551769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e4a7e22-07fc-4aa8-b451-854739ccae0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.551849] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e4a7e22-07fc-4aa8-b451-854739ccae0f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.555856] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.555856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.555856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.555856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.555856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.555856] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.555856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.555856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.555856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.555856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.555856] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c792349-7376-489a-b7da-3c608db236ad is going to be updated. [ 675.585344] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.585517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.585583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.585869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.585942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.602164] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c792349-7376-489a-b7da-3c608db236ad in Status: IN_PROGRESS for 2s [ 675.735010] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.735457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.735457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.735457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.735639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.735687] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 is going to be created. [ 675.764289] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.764560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.764560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.764769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.764971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.776022] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: UNINITIALIZED for 2s [ 675.810093] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.002091] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.002091] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.002335] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.002427] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.002575] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.002722] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f not found, creating... [ 676.002981] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.003161] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.003254] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.003484] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.003614] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.003882] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.004159] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.004304] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.004537] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.004693] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.004853] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f is going to be created. [ 676.025226] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.025425] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.025553] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.025899] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.026135] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.026352] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.054276] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e4a7e22-07fc-4aa8-b451-854739ccae0f [ 676.054276] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.054500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.054551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.055238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.055238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.055238] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e4a7e22-07fc-4aa8-b451-854739ccae0f already deleted. [ 676.055238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e4a7e22-07fc-4aa8-b451-854739ccae0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.312536] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62b70f12-d63b-40fb-b48e-a611590fad1f: rpc.has_security_group_logging(os_id): False [ 676.333484] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.333714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.333830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.333984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.334093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.334367] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.334485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.334541] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.334687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.334762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.337719] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be created. [ 676.415633] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.415773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.415849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.416068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.416258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.428090] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: IN_PROGRESS for 2s [ 676.799611] env[66157]: INFO networking_nsxv3.common.synchronization [req-f2e1bf24-897e-4004-9c45-896c8585393a req-2e51d378-04f5-4f7b-90a8-0f708f5fa019 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 676.800143] env[66157]: INFO networking_nsxv3.common.synchronization [req-f2e1bf24-897e-4004-9c45-896c8585393a req-2e51d378-04f5-4f7b-90a8-0f708f5fa019 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 676.800143] env[66157]: INFO networking_nsxv3.common.synchronization [req-f2e1bf24-897e-4004-9c45-896c8585393a req-2e51d378-04f5-4f7b-90a8-0f708f5fa019 service nova] Enqueued Resource ID: 0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f with Priority: HIGHEST for action port [ 676.800419] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 676.800555] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 676.800697] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f with Priority: HIGHEST for action port [ 676.801088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.801876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.801876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.801876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.802058] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.804929] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.804929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.804929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.804929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.804929] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.804929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.804929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.804929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.804929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.804929] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.805412] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.805492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.805597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.805805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.805894] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.308624] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.309062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.310088] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.311177] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f with status ACTIVE [ 677.313033] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.313033] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.313033] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.313033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.314170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.314170] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f is going to be updated. [ 677.343879] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.343879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.343879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.343879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.343879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.343879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b5deaf5-9c2e-4ac5-aff9-a967bd91d70f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.612655] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c792349-7376-489a-b7da-3c608db236ad in Status: SUCCESS [ 677.613433] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c792349-7376-489a-b7da-3c608db236ad deletion is rescheduled due to dependency. [ 677.613594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.787850] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: SUCCESS [ 677.788138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.788220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.788501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.788715] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.788921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.788921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.789114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.789114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.790205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.791271] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.815965] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.083771] env[66157]: INFO networking_nsxv3.common.synchronization [None req-860d86c1-e0d0-4837-8f6e-3116e1d0ecb0 None None] Enqueued Resource ID: 2e0a4713-c657-4e71-b1c2-323b81203283 with Priority: HIGHEST for action port [ 678.085593] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a4713-c657-4e71-b1c2-323b81203283 with Priority: HIGHEST for action port [ 678.085593] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e0a4713-c657-4e71-b1c2-323b81203283 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.085593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e0a4713-c657-4e71-b1c2-323b81203283" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.085593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e0a4713-c657-4e71-b1c2-323b81203283" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.085593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e0a4713-c657-4e71-b1c2-323b81203283" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.085593] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0a4713-c657-4e71-b1c2-323b81203283',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.296211] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.296378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.296456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.296772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.296945] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.297036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.297080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.297216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.297416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.297533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.297703] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.298030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.298030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.298213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.298213] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.298330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.298399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.298592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.298738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.298841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.298874] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.319459] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.319617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.319688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.319909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.319999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.321510] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be created. [ 678.426024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.426024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.426024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.426024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.426024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.436345] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: UNINITIALIZED for 2s [ 678.440286] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: SUCCESS [ 678.440286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.587810] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e0a4713-c657-4e71-b1c2-323b81203283 [ 678.588578] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.588578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.588578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.588578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.588876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.588876] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e0a4713-c657-4e71-b1c2-323b81203283 already deleted. [ 678.588876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e0a4713-c657-4e71-b1c2-323b81203283" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.805037] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa17bf86-d9f7-4a25-9da0-fb074266f0a1: rpc.has_security_group_logging(os_id): False [ 678.825291] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.825756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.825756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.825756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.826769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.826769] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.826769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.826769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.826769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.826769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.826769] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.826769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.827081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.827081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.827081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.827278] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.827367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.827424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.827574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.827654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.827736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 is going to be created. [ 678.894730] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.894888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.895025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.896210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.897569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.920667] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: IN_PROGRESS for 2s [ 679.347699] env[66157]: INFO networking_nsxv3.common.synchronization [req-53b81672-7c0b-4723-af81-c254fe5ac29c req-3ea1ca35-b754-4cbb-a431-48f7e69bb459 tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 679.347699] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 679.349320] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.349320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.349320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.349704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.349894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.351131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.351131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.351453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.351453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.351558] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.801434] env[66157]: INFO networking_nsxv3.common.synchronization [None req-b8935cb0-8e9e-41b6-b371-1b9e2d35bb8d None None] Enqueued Resource ID: 66b0a022-b906-40fc-919c-b975a4a7c9ab with Priority: HIGHEST for action port [ 679.801434] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66b0a022-b906-40fc-919c-b975a4a7c9ab with Priority: HIGHEST for action port [ 679.801434] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-66b0a022-b906-40fc-919c-b975a4a7c9ab taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.801434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66b0a022-b906-40fc-919c-b975a4a7c9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.801434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66b0a022-b906-40fc-919c-b975a4a7c9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.801815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66b0a022-b906-40fc-919c-b975a4a7c9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.801962] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66b0a022-b906-40fc-919c-b975a4a7c9ab',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.827746] env[66157]: INFO networking_nsxv3.common.synchronization [req-53b81672-7c0b-4723-af81-c254fe5ac29c req-15844e18-1a33-46e4-8490-9f56bf096255 tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 679.828244] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 679.828728] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.828728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.856184] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.164140] env[66157]: INFO networking_nsxv3.common.synchronization [req-53b81672-7c0b-4723-af81-c254fe5ac29c req-00b474aa-ddf5-44d5-80e7-61c85dff1fa1 tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 680.164140] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 680.164834] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.165098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.304658] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66b0a022-b906-40fc-919c-b975a4a7c9ab [ 680.304897] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.305042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.305771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.305771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.305771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.305771] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66b0a022-b906-40fc-919c-b975a4a7c9ab already deleted. [ 680.305771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66b0a022-b906-40fc-919c-b975a4a7c9ab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.358558] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.448683] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 680.448880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.449503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.450127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.450805] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.450805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.450805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.450805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.451060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.451060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.451243] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.861621] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.861955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.861955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.862106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.862339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.862339] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 680.895216] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.895455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.895542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.895796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.895971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.906739] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 680.932261] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: SUCCESS [ 680.932552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.955375] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.955567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.955612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.956667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.956667] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.956667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.956667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.956667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.956667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.956667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.956667] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.956667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.957079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.957079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.957079] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.957079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.957218] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.957276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.957346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.957423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.957509] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.461551] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 681.482921] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.483122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.483214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.483492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.483612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.483854] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.484025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.485355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.485640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.485751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.486052] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.486251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.486251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.486445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.486604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.487607] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.487607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.487763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.487930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.488059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.488261] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be created. [ 681.594038] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.594250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.594291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.594622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.594905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.610225] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 681.747160] env[66157]: INFO networking_nsxv3.common.synchronization [req-e0473d8c-5880-4daf-8c33-0179fe2d9fc8 req-ca43bf94-90a1-4fa1-a8ce-6e2092983424 tempest-ListImageFiltersTestJSON-762885450 tempest-ListImageFiltersTestJSON-762885450-project-member] Enqueued Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGHEST for action security_group_members [ 681.747394] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGHEST for action security_group_members [ 681.747630] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-21980f25-eb0b-4647-8b51-f835b6f941ea taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.747812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.747908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.749190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.749190] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.749190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.749190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.750405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.750622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.750734] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.079643] env[66157]: INFO networking_nsxv3.common.synchronization [None req-8d40daab-889c-4920-9e2b-71c47724967b tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_rules [ 682.079643] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_rules [ 682.080371] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.080706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.080786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.081206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.082082] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.236984] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.236984] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.236984] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.238037] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.238431] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.238581] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.239585] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.239585] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.239585] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.239585] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.239585] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.239585] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.239585] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.239585] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.240117] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.240117] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.255149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.255149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.255149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.255461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.255461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.255551] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.255629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.255783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.256331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.257199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.257323] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21980f25-eb0b-4647-8b51-f835b6f941ea already deleted. [ 682.257442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.266014] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.266314] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.266429] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.266655] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.267256] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-10aac2a6-e170-43b5-a572-220799087a5b taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.267512] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-10aac2a6-e170-43b5-a572-220799087a5b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.267725] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-10aac2a6-e170-43b5-a572-220799087a5b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.268363] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-10aac2a6-e170-43b5-a572-220799087a5b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.268666] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10aac2a6-e170-43b5-a572-220799087a5b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.285675] env[66157]: INFO networking_nsxv3.common.synchronization [None req-906c3b9e-d06f-4a4d-a883-888437835e9d tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_rules [ 682.286566] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_rules [ 682.286858] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.287293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.605738] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.606193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.606193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.606380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.606380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.606483] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c already deleted. [ 682.606561] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.606745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.606922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.607059] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.773293] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.773293] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.773293] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.773646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.773646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.773773] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 10aac2a6-e170-43b5-a572-220799087a5b not found, creating... [ 682.773970] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.774166] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.774231] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.774467] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.774595] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.774863] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.775021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.775129] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.776408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.776408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.776408] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 10aac2a6-e170-43b5-a572-220799087a5b is going to be created. [ 682.802746] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.802958] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.803093] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.803428] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.803670] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.803895] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-10aac2a6-e170-43b5-a572-220799087a5b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.916745] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 682.916969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.917654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.917654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.917654] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.917654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.917890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.917890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.917955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.918064] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.130120] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.130447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.130447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.130595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.130664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.130752] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c already deleted. [ 683.130830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.167425] env[66157]: INFO networking_nsxv3.common.synchronization [None req-06b718be-9e7e-4848-a81f-6521b45a395f None None] Enqueued Resource ID: f9967d27-3c10-43df-a819-770215a69573 with Priority: HIGHEST for action port [ 683.167586] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9967d27-3c10-43df-a819-770215a69573 with Priority: HIGHEST for action port [ 683.168391] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9967d27-3c10-43df-a819-770215a69573 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.168527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9967d27-3c10-43df-a819-770215a69573" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.168596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9967d27-3c10-43df-a819-770215a69573" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.168823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9967d27-3c10-43df-a819-770215a69573" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.168934] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9967d27-3c10-43df-a819-770215a69573',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.422574] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.422756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.422830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.423111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.423215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.423455] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.423623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.423623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.423856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.423940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.424054] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 683.459931] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.460106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.460152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.460391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.460538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.471888] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 683.546135] env[66157]: INFO networking_nsxv3.common.synchronization [req-e0473d8c-5880-4daf-8c33-0179fe2d9fc8 req-bbfbf439-149d-495a-acb5-7ebc67ae4dfd service nova] Enqueued Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGHEST for action security_group_rules [ 683.546780] env[66157]: INFO networking_nsxv3.common.synchronization [req-e0473d8c-5880-4daf-8c33-0179fe2d9fc8 req-bbfbf439-149d-495a-acb5-7ebc67ae4dfd service nova] Enqueued Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGHEST for action security_group_members [ 683.546780] env[66157]: INFO networking_nsxv3.common.synchronization [req-e0473d8c-5880-4daf-8c33-0179fe2d9fc8 req-bbfbf439-149d-495a-acb5-7ebc67ae4dfd service nova] Enqueued Resource ID: 10aac2a6-e170-43b5-a572-220799087a5b with Priority: HIGHEST for action port [ 683.547458] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGHEST for action security_group_rules [ 683.547598] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGHEST for action security_group_members [ 683.547704] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10aac2a6-e170-43b5-a572-220799087a5b with Priority: HIGHEST for action port [ 683.548056] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21980f25-eb0b-4647-8b51-f835b6f941ea taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.548733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.548733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.548733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.548733] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.549829] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-21980f25-eb0b-4647-8b51-f835b6f941ea taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.552022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.552022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.552022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.552022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.552022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.552022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.552022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.552022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.552022] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.553829] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-10aac2a6-e170-43b5-a572-220799087a5b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.553829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10aac2a6-e170-43b5-a572-220799087a5b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.553829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10aac2a6-e170-43b5-a572-220799087a5b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.554060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10aac2a6-e170-43b5-a572-220799087a5b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.554060] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10aac2a6-e170-43b5-a572-220799087a5b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.622803] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 683.623803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.672371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9967d27-3c10-43df-a819-770215a69573 [ 683.672371] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.672371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.672371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.672371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.672371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.672371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9967d27-3c10-43df-a819-770215a69573 already deleted. [ 683.672371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9967d27-3c10-43df-a819-770215a69573" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.059029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-21980f25-eb0b-4647-8b51-f835b6f941ea taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.059029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.059029] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.059029] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10aac2a6-e170-43b5-a572-220799087a5b with status ACTIVE [ 684.059029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.059029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.059579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.059579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.059579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.059795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.059900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.059997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.060843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.060965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.061274] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.061415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.061499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.062864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.062864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.062864] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10aac2a6-e170-43b5-a572-220799087a5b is going to be updated. [ 684.088950] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.089481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.089481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.089481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.089683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.089794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10aac2a6-e170-43b5-a572-220799087a5b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.146171] env[66157]: INFO networking_nsxv3.common.synchronization [req-465cd24b-119f-4ab4-bbc2-6fb01bcf9391 req-8bf0d602-5ab2-4465-bc9d-0ed0021babc5 tempest-FloatingIPsAssociationTestJSON-1906195860 tempest-FloatingIPsAssociationTestJSON-1906195860-project-member] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 684.147242] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 684.147950] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.147950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.148221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.148328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.148551] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.148716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.148820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.149282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.149282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.149395] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.564975] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.653239] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.662238] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.662238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.662238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.662238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.662646] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.662646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.662646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.662857] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.663028] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.663272] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.663558] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.663558] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.663661] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.663798] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.663916] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.664087] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.684544] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.684734] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.684864] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.685051] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.685361] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-e404d2ea-2052-45f1-8419-e7dc497756d8 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.685545] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-e404d2ea-2052-45f1-8419-e7dc497756d8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.685700] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-e404d2ea-2052-45f1-8419-e7dc497756d8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.686068] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-e404d2ea-2052-45f1-8419-e7dc497756d8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.686228] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e404d2ea-2052-45f1-8419-e7dc497756d8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.966267] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f2780d7b-8aa2-4fe4-8763-81704f888ad2 None None] Enqueued Resource ID: cedd6489-54c1-48b3-b959-0b633679678f with Priority: HIGHEST for action port [ 684.966267] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cedd6489-54c1-48b3-b959-0b633679678f with Priority: HIGHEST for action port [ 684.966844] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-cedd6489-54c1-48b3-b959-0b633679678f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.967047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cedd6489-54c1-48b3-b959-0b633679678f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.967047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cedd6489-54c1-48b3-b959-0b633679678f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.968437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cedd6489-54c1-48b3-b959-0b633679678f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.968437] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cedd6489-54c1-48b3-b959-0b633679678f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.068456] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.068715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.068844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.069143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.069279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.069415] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21980f25-eb0b-4647-8b51-f835b6f941ea is going to be created. [ 685.102224] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.102495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.102495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.102754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.103237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.115435] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21980f25-eb0b-4647-8b51-f835b6f941ea in Status: UNINITIALIZED for 2s [ 685.157018] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.189578] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.189763] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.189885] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.190188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.190332] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.190488] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port e404d2ea-2052-45f1-8419-e7dc497756d8 not found, creating... [ 685.192387] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.192663] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.192756] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.192995] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.193159] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.193538] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.193724] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.193838] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.194069] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.194248] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.194532] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: e404d2ea-2052-45f1-8419-e7dc497756d8 is going to be created. [ 685.218224] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.218426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.218543] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.218813] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.219049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.219273] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-e404d2ea-2052-45f1-8419-e7dc497756d8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.475410] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cedd6489-54c1-48b3-b959-0b633679678f [ 685.475676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.475893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.475960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.476202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.476294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.476387] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cedd6489-54c1-48b3-b959-0b633679678f already deleted. [ 685.476469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cedd6489-54c1-48b3-b959-0b633679678f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.486729] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 685.486985] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 deletion is rescheduled due to dependency. [ 685.487224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.487297] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.487605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.487800] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.487913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.487913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.488134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.488248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.488332] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.582607] env[66157]: INFO networking_nsxv3.common.synchronization [req-50b7bea7-9e66-43f4-a499-2aeebea30a75 req-2b0c0173-daba-435b-8d66-20cc410498e8 tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 685.583069] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 685.583388] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.583561] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.583628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.583829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.583990] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.584100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.584160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.584308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.584394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.584491] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.659657] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.659800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.659800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.660014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.660121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.660372] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 is going to be updated. [ 685.693169] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.693357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.693405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.693783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.693954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.703964] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: IN_PROGRESS for 2s [ 685.964884] env[66157]: INFO networking_nsxv3.common.synchronization [req-465cd24b-119f-4ab4-bbc2-6fb01bcf9391 req-56a1a1d5-4062-4ef7-aff3-71d2c3d0e964 service nova] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_rules [ 685.964884] env[66157]: INFO networking_nsxv3.common.synchronization [req-465cd24b-119f-4ab4-bbc2-6fb01bcf9391 req-56a1a1d5-4062-4ef7-aff3-71d2c3d0e964 service nova] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 685.965121] env[66157]: INFO networking_nsxv3.common.synchronization [req-465cd24b-119f-4ab4-bbc2-6fb01bcf9391 req-56a1a1d5-4062-4ef7-aff3-71d2c3d0e964 service nova] Enqueued Resource ID: e404d2ea-2052-45f1-8419-e7dc497756d8 with Priority: HIGHEST for action port [ 685.965462] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_rules [ 685.965671] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 685.965741] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e404d2ea-2052-45f1-8419-e7dc497756d8 with Priority: HIGHEST for action port [ 685.965969] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.966122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.966187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.966378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.966533] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.967420] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.967564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.967766] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e404d2ea-2052-45f1-8419-e7dc497756d8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.967939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e404d2ea-2052-45f1-8419-e7dc497756d8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.967939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e404d2ea-2052-45f1-8419-e7dc497756d8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.968128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e404d2ea-2052-45f1-8419-e7dc497756d8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.968165] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e404d2ea-2052-45f1-8419-e7dc497756d8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.996169] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.996169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.996169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.996370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.996473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.996709] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.996832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.996906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.997116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.997203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.997305] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 686.030363] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.030363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.030363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.030513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.030549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.042579] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 686.087337] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.087522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.087522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.087803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.087990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.088356] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.088483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.088533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.088989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.088989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.088989] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 686.136459] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.136459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.136459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.136986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.136986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.150728] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 686.471410] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.471712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.471829] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e404d2ea-2052-45f1-8419-e7dc497756d8 with status ACTIVE [ 686.472531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.472531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.472531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.472531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.472531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.473164] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.473164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.473164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.473164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.473164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.473517] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.473517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.473517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.473700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.473700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.474298] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e404d2ea-2052-45f1-8419-e7dc497756d8 is going to be updated. [ 686.500160] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.500334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.500382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.500589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.500734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.500899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e404d2ea-2052-45f1-8419-e7dc497756d8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.952273] env[66157]: INFO networking_nsxv3.common.synchronization [req-f6d66b03-88d5-4c62-ab16-b591b524aa9e req-b02d6d68-c156-499c-9bfb-75cfb38d0b19 tempest-ServersTestManualDisk-850948594 tempest-ServersTestManualDisk-850948594-project-member] Enqueued Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_members [ 686.952273] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_members [ 686.952273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dca9267-bc95-42c2-accb-8a02b78bd970 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.952273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.953457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.953457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.953457] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.953457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.953457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.953734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.953831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.954432] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.129394] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21980f25-eb0b-4647-8b51-f835b6f941ea in Status: SUCCESS [ 687.130047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.130047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.130210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.131924] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.131924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.131924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.131924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.131924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.131924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.131924] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.452043] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-818 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.454197] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-818" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.454197] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-818" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.454820] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-818" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.454927] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.455073] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.455197] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.455441] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.455597] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.455812] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.456552] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.456552] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.456552] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.456552] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.456552] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.456552] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.458598] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.458746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.458814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.460954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.460954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.460954] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.460954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.460954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.460954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.460954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.460954] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 already deleted. [ 687.460954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.490185] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.490185] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.490185] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.490185] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-818" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.490185] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-add32334-8b0e-46f4-a75c-188eec7316c0 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.490185] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-add32334-8b0e-46f4-a75c-188eec7316c0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.490185] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-add32334-8b0e-46f4-a75c-188eec7316c0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.490861] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-add32334-8b0e-46f4-a75c-188eec7316c0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.490861] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('add32334-8b0e-46f4-a75c-188eec7316c0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.636358] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-21980f25-eb0b-4647-8b51-f835b6f941ea taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.636358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.636358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.636358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.636358] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.636358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.636648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.636648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.636648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.636756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.636876] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-21980f25-eb0b-4647-8b51-f835b6f941ea taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.637022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.637022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.637160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.637291] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.637371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.637440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.637562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.637630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.637709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.637790] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.714100] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: SUCCESS [ 687.714432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.714622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.714887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.715085] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.715211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.715277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.715433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.715512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.715831] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.993880] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.994161] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.994344] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.994926] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.995120] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.995280] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port add32334-8b0e-46f4-a75c-188eec7316c0 not found, creating... [ 687.995553] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.995715] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.995838] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.996086] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.996220] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.996500] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.996650] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.996760] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.996962] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.997326] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.997564] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: add32334-8b0e-46f4-a75c-188eec7316c0 is going to be created. [ 688.021776] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.021776] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.022033] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.022585] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.023407] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.023407] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-add32334-8b0e-46f4-a75c-188eec7316c0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.058026] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 688.058270] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 deletion is rescheduled due to dependency. [ 688.058400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.140321] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21980f25-eb0b-4647-8b51-f835b6f941ea: rpc.has_security_group_logging(os_id): False [ 688.166215] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.166455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.166514] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.166752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.166880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.167145] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.167274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.168549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.168549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.168549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.168549] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.168549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.170243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.171776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.171877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.172149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.172267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.172344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.172523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.172629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.172753] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21980f25-eb0b-4647-8b51-f835b6f941ea is going to be created. [ 688.174773] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 688.176089] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 688.176089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.221150] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.270089] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.270499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.270499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.270499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.270681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.285159] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21980f25-eb0b-4647-8b51-f835b6f941ea in Status: IN_PROGRESS for 2s [ 688.577723] env[66157]: INFO networking_nsxv3.common.synchronization [None req-522b9be4-8bb0-49db-8d6b-30b0dbc30332 None None] Enqueued Resource ID: df6b406b-13de-45f2-83c9-8d93e9581dae with Priority: HIGHEST for action port [ 688.578125] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df6b406b-13de-45f2-83c9-8d93e9581dae with Priority: HIGHEST for action port [ 688.578382] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-df6b406b-13de-45f2-83c9-8d93e9581dae taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.578516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df6b406b-13de-45f2-83c9-8d93e9581dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.578589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df6b406b-13de-45f2-83c9-8d93e9581dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.581775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df6b406b-13de-45f2-83c9-8d93e9581dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.581775] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df6b406b-13de-45f2-83c9-8d93e9581dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.723713] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.829201] env[66157]: INFO networking_nsxv3.common.synchronization [req-f6d66b03-88d5-4c62-ab16-b591b524aa9e req-0535c200-cb84-42aa-8008-6ed9aa30cbf3 service nova] Enqueued Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_rules [ 688.829487] env[66157]: INFO networking_nsxv3.common.synchronization [req-f6d66b03-88d5-4c62-ab16-b591b524aa9e req-0535c200-cb84-42aa-8008-6ed9aa30cbf3 service nova] Enqueued Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_members [ 688.829615] env[66157]: INFO networking_nsxv3.common.synchronization [req-f6d66b03-88d5-4c62-ab16-b591b524aa9e req-0535c200-cb84-42aa-8008-6ed9aa30cbf3 service nova] Enqueued Resource ID: add32334-8b0e-46f4-a75c-188eec7316c0 with Priority: HIGHEST for action port [ 688.832113] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_rules [ 688.832364] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_members [ 688.832364] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: add32334-8b0e-46f4-a75c-188eec7316c0 with Priority: HIGHEST for action port [ 688.834031] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3dca9267-bc95-42c2-accb-8a02b78bd970 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.834031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.834031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.834031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.834031] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.834300] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dca9267-bc95-42c2-accb-8a02b78bd970 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.834346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.834419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.834606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.834780] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.834902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.834964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.835151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.835284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.835426] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.838952] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-add32334-8b0e-46f4-a75c-188eec7316c0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.838952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-add32334-8b0e-46f4-a75c-188eec7316c0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.838952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-add32334-8b0e-46f4-a75c-188eec7316c0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.838952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-add32334-8b0e-46f4-a75c-188eec7316c0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.838952] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('add32334-8b0e-46f4-a75c-188eec7316c0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.085918] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df6b406b-13de-45f2-83c9-8d93e9581dae [ 689.086232] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.086470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.087516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.087516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.087516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.087516] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df6b406b-13de-45f2-83c9-8d93e9581dae already deleted. [ 689.087516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df6b406b-13de-45f2-83c9-8d93e9581dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.229818] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.233226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.233349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.233587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.233750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.233794] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 is going to be updated. [ 689.276230] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.277026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.277026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.277026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.277026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.289289] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: IN_PROGRESS for 2s [ 689.339312] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dca9267-bc95-42c2-accb-8a02b78bd970 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.339530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.339730] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.341452] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port add32334-8b0e-46f4-a75c-188eec7316c0 with status ACTIVE [ 689.341708] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.341854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.341941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.342227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.342336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.343036] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.343149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.343235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.343466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.343616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.343850] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.343960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.344022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.344244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.344362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.344460] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: add32334-8b0e-46f4-a75c-188eec7316c0 is going to be updated. [ 689.373349] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.373349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.373349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.373349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.373674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.374491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-add32334-8b0e-46f4-a75c-188eec7316c0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.843293] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.308373] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21980f25-eb0b-4647-8b51-f835b6f941ea in Status: SUCCESS [ 690.308601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.355191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.355408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.355489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.355874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.355991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.356140] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 is going to be created. [ 690.389237] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.389401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.389476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.389712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.389900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.401922] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 in Status: UNINITIALIZED for 2s [ 691.310350] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: SUCCESS [ 691.310694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.310992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.312719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.313522] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.313522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.313522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.313927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.314509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.314509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.314509] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.818392] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.818490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.818531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.818807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.818957] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.819060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.819127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.819302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.819391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.819498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.819650] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.819745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.819805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.820130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.820342] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.820342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.820479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.821689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.821689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.821689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.821689] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.153241] env[66157]: INFO networking_nsxv3.common.synchronization [None req-a0d5a55d-e011-44a1-a4e4-38c8a3d8e600 None None] Enqueued Resource ID: 459028a2-d148-4580-a6de-5d7e4c53aded with Priority: HIGHEST for action port [ 692.153887] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459028a2-d148-4580-a6de-5d7e4c53aded with Priority: HIGHEST for action port [ 692.154220] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-459028a2-d148-4580-a6de-5d7e4c53aded taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.155635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-459028a2-d148-4580-a6de-5d7e4c53aded" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.155740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-459028a2-d148-4580-a6de-5d7e4c53aded" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.156101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-459028a2-d148-4580-a6de-5d7e4c53aded" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.156189] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('459028a2-d148-4580-a6de-5d7e4c53aded',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.325017] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13cfa8de-e28e-458d-8572-75b45f56b222: rpc.has_security_group_logging(os_id): False [ 692.346948] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.347606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.347606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.347606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.347606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.348048] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.348048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.348303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.348303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.348417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.348544] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.348638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.348708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.348876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.348951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.349161] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.349256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.349313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.349452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.349659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.349659] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 is going to be updated. [ 692.420010] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 in Status: SUCCESS [ 692.420693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.420693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.420884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.420982] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.421122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.421211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.421636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.421636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.421636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.421953] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.445412] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.445584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.445659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.445866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.446037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.470838] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: IN_PROGRESS for 2s [ 692.660591] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 459028a2-d148-4580-a6de-5d7e4c53aded [ 692.660840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.660980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.662261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.662555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.662659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.662768] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:459028a2-d148-4580-a6de-5d7e4c53aded already deleted. [ 692.662856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-459028a2-d148-4580-a6de-5d7e4c53aded" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.926031] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.430344] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3dca9267-bc95-42c2-accb-8a02b78bd970: rpc.has_security_group_logging(os_id): False [ 693.452156] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.452313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.452395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.452699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.453096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.453738] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.454103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.454216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.454431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.454471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.454600] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 is going to be created. [ 693.535916] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.536104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.536161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.536355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.537720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.551900] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 in Status: IN_PROGRESS for 2s [ 694.488219] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: SUCCESS [ 694.488219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.706994] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0f2a654a-d98d-468f-88ea-f23809001a5f None None] Enqueued Resource ID: 896a96d1-4796-4be2-bec0-bce4efa992ef with Priority: HIGHEST for action port [ 694.707793] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896a96d1-4796-4be2-bec0-bce4efa992ef with Priority: HIGHEST for action port [ 694.708257] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-896a96d1-4796-4be2-bec0-bce4efa992ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.708577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-896a96d1-4796-4be2-bec0-bce4efa992ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.708577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-896a96d1-4796-4be2-bec0-bce4efa992ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.708866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-896a96d1-4796-4be2-bec0-bce4efa992ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.709015] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896a96d1-4796-4be2-bec0-bce4efa992ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.968310] env[66157]: INFO networking_nsxv3.common.synchronization [None req-aa30841a-6b96-41ac-a060-22aa7937d6a1 None None] Enqueued Resource ID: 0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3 with Priority: HIGHEST for action port [ 694.968310] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3 with Priority: HIGHEST for action port [ 694.968310] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.968310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.968310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.968878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.969344] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.212027] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 896a96d1-4796-4be2-bec0-bce4efa992ef [ 695.212027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.212027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.212027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.212260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.212260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.212367] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:896a96d1-4796-4be2-bec0-bce4efa992ef already deleted. [ 695.212441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-896a96d1-4796-4be2-bec0-bce4efa992ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.472525] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3 [ 695.472592] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.473196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.473196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.473196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.473196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.473196] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3 already deleted. [ 695.473410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a0d9d2f-d398-4451-b29e-2bbd9db1b0a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.566030] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 in Status: SUCCESS [ 695.566030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.156288] env[66157]: INFO networking_nsxv3.common.synchronization [None req-2fc980c3-977e-414e-9bd1-fcbac7503eb2 None None] Enqueued Resource ID: a5011241-7fe3-413b-85b5-ce0b85f92ac4 with Priority: HIGHEST for action port [ 696.157027] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5011241-7fe3-413b-85b5-ce0b85f92ac4 with Priority: HIGHEST for action port [ 696.159053] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5011241-7fe3-413b-85b5-ce0b85f92ac4 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.159053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5011241-7fe3-413b-85b5-ce0b85f92ac4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.159053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5011241-7fe3-413b-85b5-ce0b85f92ac4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.159853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5011241-7fe3-413b-85b5-ce0b85f92ac4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.161499] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5011241-7fe3-413b-85b5-ce0b85f92ac4',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.663986] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5011241-7fe3-413b-85b5-ce0b85f92ac4 [ 696.663986] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.664533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.664533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.664628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.664734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.664889] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5011241-7fe3-413b-85b5-ce0b85f92ac4 already deleted. [ 696.665014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5011241-7fe3-413b-85b5-ce0b85f92ac4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.358093] env[66157]: INFO networking_nsxv3.common.synchronization [None req-07b80f28-a60a-4bdd-ba31-deea8d860757 None None] Enqueued Resource ID: 6dd079ae-b716-4eb4-a4e5-1de1b5cec586 with Priority: HIGHEST for action port [ 697.358342] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd079ae-b716-4eb4-a4e5-1de1b5cec586 with Priority: HIGHEST for action port [ 697.358654] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dd079ae-b716-4eb4-a4e5-1de1b5cec586 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.358775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dd079ae-b716-4eb4-a4e5-1de1b5cec586" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.358837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dd079ae-b716-4eb4-a4e5-1de1b5cec586" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.359119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dd079ae-b716-4eb4-a4e5-1de1b5cec586" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.359194] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dd079ae-b716-4eb4-a4e5-1de1b5cec586',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.861653] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dd079ae-b716-4eb4-a4e5-1de1b5cec586 [ 697.862026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.862026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.862131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.862378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.862470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.863812] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dd079ae-b716-4eb4-a4e5-1de1b5cec586 already deleted. [ 697.863812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dd079ae-b716-4eb4-a4e5-1de1b5cec586" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.890921] env[66157]: INFO networking_nsxv3.common.synchronization [None req-16619ef7-1c3e-4e8d-af2d-159a3eba8fc0 tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 698.891242] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 698.892702] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.892702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.892702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.893158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.893158] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.084168] env[66157]: INFO networking_nsxv3.common.synchronization [None req-6d7c91a5-7acf-4bac-88ef-9f1c4bfb3e2e tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 699.084985] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 699.091269] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.091269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.419459] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.419655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.419727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.419936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.420079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.420183] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 already deleted. [ 699.420267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.420841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.420978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.421085] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.485022] env[66157]: INFO networking_nsxv3.common.synchronization [None req-727e1315-82f4-4286-bde6-1f854056a772 None None] Enqueued Resource ID: 9a1348be-fbb5-4b21-9a02-c8ce51af92ba with Priority: HIGHEST for action port [ 699.485022] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a1348be-fbb5-4b21-9a02-c8ce51af92ba with Priority: HIGHEST for action port [ 699.487126] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a1348be-fbb5-4b21-9a02-c8ce51af92ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.489053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a1348be-fbb5-4b21-9a02-c8ce51af92ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.489053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a1348be-fbb5-4b21-9a02-c8ce51af92ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.489053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a1348be-fbb5-4b21-9a02-c8ce51af92ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.489053] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a1348be-fbb5-4b21-9a02-c8ce51af92ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.596527] env[66157]: INFO networking_nsxv3.common.synchronization [None req-78f59d07-5564-4bab-8c7c-ea83050744e4 None None] Enqueued Resource ID: 23077c32-e4e9-49ab-9bbf-2fb53449d211 with Priority: HIGHEST for action port [ 699.597567] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23077c32-e4e9-49ab-9bbf-2fb53449d211 with Priority: HIGHEST for action port [ 699.597567] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-23077c32-e4e9-49ab-9bbf-2fb53449d211 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.597567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23077c32-e4e9-49ab-9bbf-2fb53449d211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.597567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23077c32-e4e9-49ab-9bbf-2fb53449d211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.597796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23077c32-e4e9-49ab-9bbf-2fb53449d211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.597829] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23077c32-e4e9-49ab-9bbf-2fb53449d211',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.942330] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.942330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.942330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.942688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.942688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.942688] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 already deleted. [ 699.942802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.990893] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a1348be-fbb5-4b21-9a02-c8ce51af92ba [ 699.991172] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.991300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.991384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.991601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.991711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.991824] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a1348be-fbb5-4b21-9a02-c8ce51af92ba already deleted. [ 699.991919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a1348be-fbb5-4b21-9a02-c8ce51af92ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.100881] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23077c32-e4e9-49ab-9bbf-2fb53449d211 [ 700.101140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.101285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.101353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.101566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.101655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.101772] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23077c32-e4e9-49ab-9bbf-2fb53449d211 already deleted. [ 700.101829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23077c32-e4e9-49ab-9bbf-2fb53449d211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.710846] env[66157]: INFO networking_nsxv3.common.synchronization [None req-6095fa17-ea3e-426e-9a17-78494d1bc40c None None] Enqueued Resource ID: 66ceee58-f847-43ab-a575-66b5529ad7fa with Priority: HIGHEST for action port [ 701.711247] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ceee58-f847-43ab-a575-66b5529ad7fa with Priority: HIGHEST for action port [ 701.711829] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-66ceee58-f847-43ab-a575-66b5529ad7fa taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.711829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66ceee58-f847-43ab-a575-66b5529ad7fa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.712079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66ceee58-f847-43ab-a575-66b5529ad7fa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.715596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66ceee58-f847-43ab-a575-66b5529ad7fa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.715596] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66ceee58-f847-43ab-a575-66b5529ad7fa',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.880367] env[66157]: INFO networking_nsxv3.common.synchronization [None req-4425d9ee-4e08-4d1d-99dd-f3bedcaaa737 None None] Enqueued Resource ID: 0876ce3d-ad0c-41c1-a265-25f37b953a62 with Priority: HIGHEST for action port [ 701.880367] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0876ce3d-ad0c-41c1-a265-25f37b953a62 with Priority: HIGHEST for action port [ 701.880766] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0876ce3d-ad0c-41c1-a265-25f37b953a62 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.882066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0876ce3d-ad0c-41c1-a265-25f37b953a62" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.882066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0876ce3d-ad0c-41c1-a265-25f37b953a62" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.882066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0876ce3d-ad0c-41c1-a265-25f37b953a62" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.882066] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0876ce3d-ad0c-41c1-a265-25f37b953a62',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.218806] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66ceee58-f847-43ab-a575-66b5529ad7fa [ 702.219103] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.219271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.219342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.219599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.219708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.219810] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66ceee58-f847-43ab-a575-66b5529ad7fa already deleted. [ 702.219892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66ceee58-f847-43ab-a575-66b5529ad7fa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.386826] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0876ce3d-ad0c-41c1-a265-25f37b953a62 [ 702.387760] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.387760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.387760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.387760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.387760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.387760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0876ce3d-ad0c-41c1-a265-25f37b953a62 already deleted. [ 702.388195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0876ce3d-ad0c-41c1-a265-25f37b953a62" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.694399] env[66157]: INFO networking_nsxv3.common.synchronization [None req-cff09e19-9e8d-4590-996e-458eb80c4fdc None None] Enqueued Resource ID: 374756aa-b9f4-4a8a-a3b2-78586565061e with Priority: HIGHEST for action port [ 702.694969] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 374756aa-b9f4-4a8a-a3b2-78586565061e with Priority: HIGHEST for action port [ 702.695301] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-374756aa-b9f4-4a8a-a3b2-78586565061e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.695422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-374756aa-b9f4-4a8a-a3b2-78586565061e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.695487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-374756aa-b9f4-4a8a-a3b2-78586565061e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.695734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-374756aa-b9f4-4a8a-a3b2-78586565061e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.695813] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374756aa-b9f4-4a8a-a3b2-78586565061e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.086329] env[66157]: INFO networking_nsxv3.common.synchronization [req-01f587ce-e13e-45f7-8b6a-d506fc51d1e5 req-6d118af0-cbf6-4ff7-b643-0774c18f78f6 tempest-ServersAdminTestJSON-1739826864 tempest-ServersAdminTestJSON-1739826864-project-member] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 703.087264] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 703.091181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.091181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.091181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.091181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.091557] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.091557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.091557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.091769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.091769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.091868] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.201627] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 374756aa-b9f4-4a8a-a3b2-78586565061e [ 703.201627] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.201627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.201627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.201627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.201627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.202116] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:374756aa-b9f4-4a8a-a3b2-78586565061e already deleted. [ 703.202116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-374756aa-b9f4-4a8a-a3b2-78586565061e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.594889] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.644634] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.644826] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.644971] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.645618] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.645891] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.646520] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.646520] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.646520] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.646520] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.646719] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.647229] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.647229] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.647229] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.647229] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.647477] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.647644] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.683804] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.686096] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.686096] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.686096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.686096] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-fc3b0c40-0a14-4121-9910-00c1465ff623 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.686096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-fc3b0c40-0a14-4121-9910-00c1465ff623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.686096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-fc3b0c40-0a14-4121-9910-00c1465ff623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.686096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-fc3b0c40-0a14-4121-9910-00c1465ff623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.686096] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc3b0c40-0a14-4121-9910-00c1465ff623',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.097663] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.191161] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.191161] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.191161] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.191482] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.191526] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.191763] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port fc3b0c40-0a14-4121-9910-00c1465ff623 not found, creating... [ 704.191955] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.192153] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.194194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.194194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.194194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.194194] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.194194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.194194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.194194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.194194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.194194] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: fc3b0c40-0a14-4121-9910-00c1465ff623 is going to be created. [ 704.222169] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.222169] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.222169] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.222169] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.222746] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.222746] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-fc3b0c40-0a14-4121-9910-00c1465ff623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.599947] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.600319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.600404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.601676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.601676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.601676] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 704.639025] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.639025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.639025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.639025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.639025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.651711] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 704.936029] env[66157]: INFO networking_nsxv3.common.synchronization [req-01f587ce-e13e-45f7-8b6a-d506fc51d1e5 req-61397a11-2344-46e5-9181-45dd62d41007 service nova] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_rules [ 704.937347] env[66157]: INFO networking_nsxv3.common.synchronization [req-01f587ce-e13e-45f7-8b6a-d506fc51d1e5 req-61397a11-2344-46e5-9181-45dd62d41007 service nova] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 704.937347] env[66157]: INFO networking_nsxv3.common.synchronization [req-01f587ce-e13e-45f7-8b6a-d506fc51d1e5 req-61397a11-2344-46e5-9181-45dd62d41007 service nova] Enqueued Resource ID: fc3b0c40-0a14-4121-9910-00c1465ff623 with Priority: HIGHEST for action port [ 704.937347] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_rules [ 704.937347] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 704.937347] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc3b0c40-0a14-4121-9910-00c1465ff623 with Priority: HIGHEST for action port [ 704.938338] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.938338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.938338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.938338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.938564] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.940684] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.941723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.941723] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc3b0c40-0a14-4121-9910-00c1465ff623 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.941723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc3b0c40-0a14-4121-9910-00c1465ff623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.941723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc3b0c40-0a14-4121-9910-00c1465ff623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.941723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc3b0c40-0a14-4121-9910-00c1465ff623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.942663] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc3b0c40-0a14-4121-9910-00c1465ff623',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.444669] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.444669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.448195] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc3b0c40-0a14-4121-9910-00c1465ff623 with status ACTIVE [ 705.448539] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.448767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.448889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.449198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.449357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.449819] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.449819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.449966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.450219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.450293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.450550] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.450706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.450821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.452933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.453185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.453294] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc3b0c40-0a14-4121-9910-00c1465ff623 is going to be updated. [ 705.476771] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.476987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.477118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.477384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.477555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.478082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc3b0c40-0a14-4121-9910-00c1465ff623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.490085] env[66157]: INFO networking_nsxv3.common.synchronization [req-f61734ee-03ec-42c6-93cc-0f487eb9d27f req-0711f178-6c97-40f8-b839-4bd65886eea1 tempest-ImagesOneServerTestJSON-1802965392 tempest-ImagesOneServerTestJSON-1802965392-project-member] Enqueued Resource ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c with Priority: HIGHEST for action security_group_members [ 705.490620] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c with Priority: HIGHEST for action security_group_members [ 705.490914] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38d5e1a-6785-4c65-98b8-9c43e55d070c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.491076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.491117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.491351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.493221] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.493221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.493221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.493221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.493221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.493221] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a38d5e1a-6785-4c65-98b8-9c43e55d070c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.896015] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.896290] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-827" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.896354] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-827" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.896629] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-827" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.896880] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.897407] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.897407] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.897407] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.897551] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.897766] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.897877] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.897981] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.898097] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.898201] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.898299] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.898422] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.916678] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.916869] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.916981] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.917183] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-827" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.917719] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-2b7445fa-9f36-4f05-a3ce-34e692c7c179 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.917926] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-2b7445fa-9f36-4f05-a3ce-34e692c7c179" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.918172] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-2b7445fa-9f36-4f05-a3ce-34e692c7c179" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.918552] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-2b7445fa-9f36-4f05-a3ce-34e692c7c179" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.918727] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b7445fa-9f36-4f05-a3ce-34e692c7c179',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.995706] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.995865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.995938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.996185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.996293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.996698] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.996766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.996893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.997034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.997034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.997128] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c already deleted. [ 705.997191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.421445] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.421672] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.421805] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.422521] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.422521] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.422521] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 2b7445fa-9f36-4f05-a3ce-34e692c7c179 not found, creating... [ 706.422784] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.422950] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.423070] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.423319] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.423469] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.423763] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.424059] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.424148] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.424305] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.424450] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.424581] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 2b7445fa-9f36-4f05-a3ce-34e692c7c179 is going to be created. [ 706.446244] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.446244] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.446864] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.446864] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.447056] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.447207] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-2b7445fa-9f36-4f05-a3ce-34e692c7c179" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.661967] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 706.662280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.662452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.662662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.662840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.663721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.663721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.663721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.663721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.663721] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.107764] env[66157]: INFO networking_nsxv3.common.synchronization [None req-979a4895-de02-4688-b1c2-6f16d32c6a82 None None] Enqueued Resource ID: 77fe578b-26a3-42b5-9fb5-df10e9b9f197 with Priority: HIGHEST for action port [ 707.108562] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77fe578b-26a3-42b5-9fb5-df10e9b9f197 with Priority: HIGHEST for action port [ 707.108948] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-77fe578b-26a3-42b5-9fb5-df10e9b9f197 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.109126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77fe578b-26a3-42b5-9fb5-df10e9b9f197" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.109195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77fe578b-26a3-42b5-9fb5-df10e9b9f197" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.109448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77fe578b-26a3-42b5-9fb5-df10e9b9f197" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.109531] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77fe578b-26a3-42b5-9fb5-df10e9b9f197',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.164357] env[66157]: INFO networking_nsxv3.common.synchronization [None req-7406fe47-bb24-4819-8985-f40374698d51 None None] Enqueued Resource ID: 148f2831-85c7-4c3e-9139-93cd5937eec5 with Priority: HIGHEST for action port [ 707.164905] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 148f2831-85c7-4c3e-9139-93cd5937eec5 with Priority: HIGHEST for action port [ 707.165253] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-148f2831-85c7-4c3e-9139-93cd5937eec5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.165381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-148f2831-85c7-4c3e-9139-93cd5937eec5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.165440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-148f2831-85c7-4c3e-9139-93cd5937eec5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.165712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-148f2831-85c7-4c3e-9139-93cd5937eec5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.165796] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('148f2831-85c7-4c3e-9139-93cd5937eec5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.167382] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.224603] env[66157]: INFO networking_nsxv3.common.synchronization [req-f61734ee-03ec-42c6-93cc-0f487eb9d27f req-a5f94732-08fa-4b46-aa19-79c227c22c00 service nova] Enqueued Resource ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c with Priority: HIGHEST for action security_group_rules [ 707.225774] env[66157]: INFO networking_nsxv3.common.synchronization [req-f61734ee-03ec-42c6-93cc-0f487eb9d27f req-a5f94732-08fa-4b46-aa19-79c227c22c00 service nova] Enqueued Resource ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c with Priority: HIGHEST for action security_group_members [ 707.226584] env[66157]: INFO networking_nsxv3.common.synchronization [req-f61734ee-03ec-42c6-93cc-0f487eb9d27f req-a5f94732-08fa-4b46-aa19-79c227c22c00 service nova] Enqueued Resource ID: 2b7445fa-9f36-4f05-a3ce-34e692c7c179 with Priority: HIGHEST for action port [ 707.228581] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c with Priority: HIGHEST for action security_group_rules [ 707.228685] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c with Priority: HIGHEST for action security_group_members [ 707.229473] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7445fa-9f36-4f05-a3ce-34e692c7c179 with Priority: HIGHEST for action port [ 707.229473] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a38d5e1a-6785-4c65-98b8-9c43e55d070c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.229473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.229473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.229735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.230502] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a38d5e1a-6785-4c65-98b8-9c43e55d070c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.231216] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38d5e1a-6785-4c65-98b8-9c43e55d070c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.231216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.231216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.231216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.231216] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.231458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.231458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.231530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.231699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.231699] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a38d5e1a-6785-4c65-98b8-9c43e55d070c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.233192] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b7445fa-9f36-4f05-a3ce-34e692c7c179 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.233192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b7445fa-9f36-4f05-a3ce-34e692c7c179" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.233192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b7445fa-9f36-4f05-a3ce-34e692c7c179" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.233192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b7445fa-9f36-4f05-a3ce-34e692c7c179" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.233192] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b7445fa-9f36-4f05-a3ce-34e692c7c179',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.612639] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77fe578b-26a3-42b5-9fb5-df10e9b9f197 [ 707.613135] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.613135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.613135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.613693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.613693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.613693] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77fe578b-26a3-42b5-9fb5-df10e9b9f197 already deleted. [ 707.613693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77fe578b-26a3-42b5-9fb5-df10e9b9f197" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.669740] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 148f2831-85c7-4c3e-9139-93cd5937eec5 [ 707.669740] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.670531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.670531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.670815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.670949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.671089] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:148f2831-85c7-4c3e-9139-93cd5937eec5 already deleted. [ 707.671245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-148f2831-85c7-4c3e-9139-93cd5937eec5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.671536] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.734618] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a38d5e1a-6785-4c65-98b8-9c43e55d070c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.736267] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38d5e1a-6785-4c65-98b8-9c43e55d070c taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.736267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.736560] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b7445fa-9f36-4f05-a3ce-34e692c7c179 with status ACTIVE [ 707.736726] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.736867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.737147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.737208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.737837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.737837] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.737837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.737837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.737837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.737837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.738161] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.738161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.738161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.738462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.738462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.738462] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b7445fa-9f36-4f05-a3ce-34e692c7c179 is going to be updated. [ 707.764220] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.764350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.764350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.764519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.764790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.764869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b7445fa-9f36-4f05-a3ce-34e692c7c179" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.175343] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.175577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.175577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.175777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.175875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.175977] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 708.207506] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.207889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.207889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.208065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.208220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.220330] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 708.239744] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a38d5e1a-6785-4c65-98b8-9c43e55d070c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.742553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.742871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.742871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.742988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.743095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.743201] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c is going to be created. [ 708.770711] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.770711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.770711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.770711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.770936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.781824] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c in Status: UNINITIALIZED for 2s [ 710.232792] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 4s [ 710.388581] env[66157]: INFO networking_nsxv3.common.synchronization [req-1eb4156d-18fa-4b76-bf9b-27e33003a873 req-3d5d632b-61c1-4d90-a838-2761a1976fb9 tempest-DeleteServersAdminTestJSON-1142677805 tempest-DeleteServersAdminTestJSON-1142677805-project-member] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 710.389401] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 710.389727] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.389854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.389917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.390130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.390308] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.390414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.390603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.390753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.390838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.391591] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.721093] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.721295] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.721484] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.721687] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.721952] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.723118] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.723304] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.723524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.723667] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.723875] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.723984] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.724139] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.724282] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.724399] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.724603] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.724669] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.747341] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.747504] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.747846] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.747846] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.748276] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-acede112-98ec-44dc-b043-55c5f569f3d0 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.748390] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-acede112-98ec-44dc-b043-55c5f569f3d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.748433] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-acede112-98ec-44dc-b043-55c5f569f3d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.748745] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-acede112-98ec-44dc-b043-55c5f569f3d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.748873] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acede112-98ec-44dc-b043-55c5f569f3d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.792178] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c in Status: SUCCESS [ 710.792403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.792573] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.792778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.792967] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.793096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.793162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.793310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.793390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.793474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.793562] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a38d5e1a-6785-4c65-98b8-9c43e55d070c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.894357] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.894524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.894600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.894848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.895179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.895264] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.895401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.895462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.895633] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.895725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.895816] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 is going to be updated. [ 710.926465] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.926635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.926685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.926914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.927084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.936627] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: IN_PROGRESS for 2s [ 710.939215] env[66157]: INFO networking_nsxv3.common.synchronization [req-031055d9-93f8-4eeb-bcf3-46e0364a303d req-34839470-58e9-479b-8dd1-c14c265d6c7e tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 710.939925] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 710.940266] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.940506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.940593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.940810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.940980] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.941098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.941166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.941324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.941411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.941516] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.252340] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.252340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.252340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.252944] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.252944] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.252944] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port acede112-98ec-44dc-b043-55c5f569f3d0 not found, creating... [ 711.253093] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.253272] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.253415] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.253643] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.253781] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.254147] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.254321] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.254394] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.254637] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.254720] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.254858] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: acede112-98ec-44dc-b043-55c5f569f3d0 is going to be created. [ 711.275503] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.275719] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.275840] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.276152] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.276386] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.276665] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-acede112-98ec-44dc-b043-55c5f569f3d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.297104] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38d5e1a-6785-4c65-98b8-9c43e55d070c taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.297282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.297366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.297582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.298088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.298088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.298088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.298088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.298355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.298355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.298423] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38d5e1a-6785-4c65-98b8-9c43e55d070c taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.298469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.298502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.298669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.300103] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.300103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.300103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.300103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.300327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.300327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.300327] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a38d5e1a-6785-4c65-98b8-9c43e55d070c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.443992] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.444251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.444333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.444551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.444651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.444846] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.444952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.445024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.445280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.445384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.445478] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 711.487021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.487248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.487331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.487619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.488217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.506668] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 711.802815] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a38d5e1a-6785-4c65-98b8-9c43e55d070c: rpc.has_security_group_logging(os_id): False [ 711.822965] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.822965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.823115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.823390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.823507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.823812] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.824129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.824129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.824237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.824296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.824510] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.824626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.824721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.824886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.824953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.825252] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.825385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.825385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.825498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.825601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.825812] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c is going to be created. [ 711.893180] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.893399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.893452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.893648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.893830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.907692] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c in Status: IN_PROGRESS for 2s [ 711.932248] env[66157]: INFO networking_nsxv3.common.synchronization [req-cf01f311-0092-476a-aac2-b6bef2e1f338 req-0685097b-61e0-4d8f-a987-fcd51f17f8ad tempest-ListImageFiltersTestJSON-762885450 tempest-ListImageFiltersTestJSON-762885450-project-member] Enqueued Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGHEST for action security_group_members [ 711.932803] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGHEST for action security_group_members [ 711.933114] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-21980f25-eb0b-4647-8b51-f835b6f941ea taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.933237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.933304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.933499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.933659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.933765] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.933867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.933964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.934107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.934196] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.011379] env[66157]: INFO networking_nsxv3.common.synchronization [req-1eb4156d-18fa-4b76-bf9b-27e33003a873 req-b05aee4a-aee0-4fea-bbeb-672bf7163aed service nova] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_rules [ 712.011553] env[66157]: INFO networking_nsxv3.common.synchronization [req-1eb4156d-18fa-4b76-bf9b-27e33003a873 req-b05aee4a-aee0-4fea-bbeb-672bf7163aed service nova] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 712.011683] env[66157]: INFO networking_nsxv3.common.synchronization [req-1eb4156d-18fa-4b76-bf9b-27e33003a873 req-b05aee4a-aee0-4fea-bbeb-672bf7163aed service nova] Enqueued Resource ID: acede112-98ec-44dc-b043-55c5f569f3d0 with Priority: HIGHEST for action port [ 712.012216] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_rules [ 712.012363] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 712.013722] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acede112-98ec-44dc-b043-55c5f569f3d0 with Priority: HIGHEST for action port [ 712.013722] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.013722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.014015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.014015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.014256] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.017079] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.018079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.018329] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-acede112-98ec-44dc-b043-55c5f569f3d0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.018439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acede112-98ec-44dc-b043-55c5f569f3d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.018511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acede112-98ec-44dc-b043-55c5f569f3d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.022017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acede112-98ec-44dc-b043-55c5f569f3d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.022017] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acede112-98ec-44dc-b043-55c5f569f3d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.246696] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 712.247029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.247227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.247458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.247691] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.248029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.248135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.248339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.248469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.248575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.248877] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.438327] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.438327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.438327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.438327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.438327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.438327] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.438327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.438327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.438327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.438327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.438327] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21980f25-eb0b-4647-8b51-f835b6f941ea is going to be updated. [ 712.495468] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.495639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.495711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.495939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.496100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.506110] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21980f25-eb0b-4647-8b51-f835b6f941ea in Status: IN_PROGRESS for 2s [ 712.521784] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.521916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.522165] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acede112-98ec-44dc-b043-55c5f569f3d0 with status ACTIVE [ 712.522359] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.522495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.522607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.522841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.522903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.523105] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.523264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.523373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.523581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.523665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.523900] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.524041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.524174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.524333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.524412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.524501] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acede112-98ec-44dc-b043-55c5f569f3d0 is going to be updated. [ 712.546207] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.546959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.546959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.546959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.546959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.547180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acede112-98ec-44dc-b043-55c5f569f3d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.758811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.758811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.758811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.758811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.758811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.759607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.759607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.759607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.759607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.759607] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.953372] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: SUCCESS [ 712.953372] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 deletion is rescheduled due to dependency. [ 712.953372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.953372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.953372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.953595] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.953595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.953595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.953723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.954176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.954176] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.261809] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 222383c0-b19b-4725-af40-286f27465c68: rpc.has_security_group_logging(os_id): False [ 713.283798] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.283985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.284085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.284288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.284438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.287688] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.287688] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.287688] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.287688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.288910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.288910] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 713.383437] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.383655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.383655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.384055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.384055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.399677] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 713.461287] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.519044] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 713.519255] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef deletion is rescheduled due to dependency. [ 713.519341] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.698744] env[66157]: INFO networking_nsxv3.common.synchronization [None req-1449e05d-5c52-46df-bf02-1a2c5ee806a6 None None] Enqueued Resource ID: fce1e8b0-34bf-4830-9248-14d881cee432 with Priority: HIGHEST for action port [ 713.698744] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fce1e8b0-34bf-4830-9248-14d881cee432 with Priority: HIGHEST for action port [ 713.698744] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-fce1e8b0-34bf-4830-9248-14d881cee432 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.698744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fce1e8b0-34bf-4830-9248-14d881cee432" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.698744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fce1e8b0-34bf-4830-9248-14d881cee432" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.698744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fce1e8b0-34bf-4830-9248-14d881cee432" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.698744] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fce1e8b0-34bf-4830-9248-14d881cee432',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.921308] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c in Status: SUCCESS [ 713.921308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.964017] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.205439] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fce1e8b0-34bf-4830-9248-14d881cee432 [ 714.205633] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.206295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.206295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.206295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.206295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.206295] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fce1e8b0-34bf-4830-9248-14d881cee432 already deleted. [ 714.206295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fce1e8b0-34bf-4830-9248-14d881cee432" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.466576] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.466866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.467082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.467748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.467989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.472036] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 is going to be updated. [ 714.508037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.508311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.508505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.508619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.508808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.521450] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: IN_PROGRESS for 2s [ 714.522566] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21980f25-eb0b-4647-8b51-f835b6f941ea in Status: SUCCESS [ 714.522566] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21980f25-eb0b-4647-8b51-f835b6f941ea deletion is rescheduled due to dependency. [ 714.522566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.421570] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 715.421570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.493460] env[66157]: INFO networking_nsxv3.common.synchronization [None req-fb01a366-91c4-41f7-9534-9267111a8d61 None None] Enqueued Resource ID: e4a41479-9647-45d8-9b0e-a2273fc6d638 with Priority: HIGHEST for action port [ 716.493460] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4a41479-9647-45d8-9b0e-a2273fc6d638 with Priority: HIGHEST for action port [ 716.493460] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4a41479-9647-45d8-9b0e-a2273fc6d638 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.493460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4a41479-9647-45d8-9b0e-a2273fc6d638" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.493864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4a41479-9647-45d8-9b0e-a2273fc6d638" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.493864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4a41479-9647-45d8-9b0e-a2273fc6d638" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.493864] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4a41479-9647-45d8-9b0e-a2273fc6d638',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.532540] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: SUCCESS [ 716.532596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.532828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.533135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.533700] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.533700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.533700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.533700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.534105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.534105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.534105] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.567274] env[66157]: INFO networking_nsxv3.common.synchronization [None req-30aad10e-630b-421b-b433-c2ab0bce5180 None None] Enqueued Resource ID: e5b3494e-de22-4479-96dc-ad6f374dbf27 with Priority: HIGHEST for action port [ 716.567274] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b3494e-de22-4479-96dc-ad6f374dbf27 with Priority: HIGHEST for action port [ 716.567274] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5b3494e-de22-4479-96dc-ad6f374dbf27 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.567274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5b3494e-de22-4479-96dc-ad6f374dbf27" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.567717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5b3494e-de22-4479-96dc-ad6f374dbf27" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.568093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5b3494e-de22-4479-96dc-ad6f374dbf27" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.568284] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5b3494e-de22-4479-96dc-ad6f374dbf27',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.947369] env[66157]: INFO networking_nsxv3.common.synchronization [None req-dd604f9b-aefa-494b-8fda-e14d4b1bfae0 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_rules [ 716.947988] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_rules [ 716.948245] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.951565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.951565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.951565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.951565] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.997459] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4a41479-9647-45d8-9b0e-a2273fc6d638 [ 716.997700] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.997836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.997916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.998173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.998262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.998371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4a41479-9647-45d8-9b0e-a2273fc6d638 already deleted. [ 716.998442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4a41479-9647-45d8-9b0e-a2273fc6d638" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.036622] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.036888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.036888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.037121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.037269] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.037423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.037500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.040232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.040390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.040553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.040747] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.040856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.040920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.041126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.041317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.041428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.041490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.041644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.041718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.042138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.042138] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.070875] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5b3494e-de22-4479-96dc-ad6f374dbf27 [ 717.071120] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.071274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.071352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.071571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.071688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.071791] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5b3494e-de22-4479-96dc-ad6f374dbf27 already deleted. [ 717.071873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5b3494e-de22-4479-96dc-ad6f374dbf27" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.158602] env[66157]: INFO networking_nsxv3.common.synchronization [None req-6d99c28c-b22b-4bdf-989f-4285de0d4e8b tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_rules [ 717.158706] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_rules [ 717.159091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.159186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.486744] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.486963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.486963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.487170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.487256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.487381] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b already deleted. [ 717.487514] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.487742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.487994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.488146] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.523075] env[66157]: INFO networking_nsxv3.common.synchronization [req-b86a572b-5445-4ef5-a061-4b9858311d65 req-df70b5af-039f-4b2a-9916-7c00aa315f3e tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 717.523468] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 717.523723] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.524278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.524278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.526114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.526317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.527170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.527170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.527170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.527170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.527170] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.548043] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8851c268-64f4-45b7-bb1b-82bd0da298c8: rpc.has_security_group_logging(os_id): False [ 717.568527] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.568750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.568750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.569080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.569185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.569343] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.569456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.569522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.569693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.569773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.569961] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.570248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.570248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.570248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.570480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.572172] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.572369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.575382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.575382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.575382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.575382] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 is going to be updated. [ 717.640647] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.640647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.640914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.640914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.641429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.660098] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: IN_PROGRESS for 2s [ 718.012098] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.012927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.013022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.013230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.014569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.014569] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b already deleted. [ 718.014569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.030377] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.030493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.030586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.030822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.030924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.031140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.031237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.031295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.031459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.031504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.031593] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 718.062676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.062897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.062966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.064742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.064742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.074453] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 718.076432] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.076621] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.076725] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.076977] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.078061] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.078061] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.078061] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.078061] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.078061] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.078318] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.078318] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.078318] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.078532] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.078532] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.078602] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.078694] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.099353] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.099521] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.099712] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.100011] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.100389] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-754de0ad-bf65-4d28-a23c-c7490b73bd77 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.100609] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-754de0ad-bf65-4d28-a23c-c7490b73bd77" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.100764] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-754de0ad-bf65-4d28-a23c-c7490b73bd77" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.101197] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-754de0ad-bf65-4d28-a23c-c7490b73bd77" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.101371] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('754de0ad-bf65-4d28-a23c-c7490b73bd77',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.604299] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.604657] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.604657] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.604952] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.605097] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.605259] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 754de0ad-bf65-4d28-a23c-c7490b73bd77 not found, creating... [ 718.605481] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.605631] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.605741] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.605954] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.606146] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.606425] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.606592] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.606706] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.606905] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.607043] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.607177] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 754de0ad-bf65-4d28-a23c-c7490b73bd77 is going to be created. [ 718.629540] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.629744] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.629850] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.630117] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.630342] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.630558] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-754de0ad-bf65-4d28-a23c-c7490b73bd77" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.903207] env[66157]: INFO networking_nsxv3.common.synchronization [None req-fce665f8-bc64-4aa9-95ff-7c348b417ea7 None None] Enqueued Resource ID: 5bedfe57-d892-4069-95fe-04362f6c6f25 with Priority: HIGHEST for action port [ 718.903819] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bedfe57-d892-4069-95fe-04362f6c6f25 with Priority: HIGHEST for action port [ 718.904340] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bedfe57-d892-4069-95fe-04362f6c6f25 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.904522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bedfe57-d892-4069-95fe-04362f6c6f25" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.904656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bedfe57-d892-4069-95fe-04362f6c6f25" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.904916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bedfe57-d892-4069-95fe-04362f6c6f25" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.905058] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bedfe57-d892-4069-95fe-04362f6c6f25',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.367027] env[66157]: INFO networking_nsxv3.common.synchronization [req-b86a572b-5445-4ef5-a061-4b9858311d65 req-1274b8b5-8cd5-43e5-b3d1-e6acff6f5cf9 service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 719.367027] env[66157]: INFO networking_nsxv3.common.synchronization [req-b86a572b-5445-4ef5-a061-4b9858311d65 req-1274b8b5-8cd5-43e5-b3d1-e6acff6f5cf9 service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 719.367027] env[66157]: INFO networking_nsxv3.common.synchronization [req-b86a572b-5445-4ef5-a061-4b9858311d65 req-1274b8b5-8cd5-43e5-b3d1-e6acff6f5cf9 service nova] Enqueued Resource ID: 754de0ad-bf65-4d28-a23c-c7490b73bd77 with Priority: HIGHEST for action port [ 719.370479] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 719.370479] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 719.370479] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754de0ad-bf65-4d28-a23c-c7490b73bd77 with Priority: HIGHEST for action port [ 719.370479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.370479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.370479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.370479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.370479] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.370479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.370479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.370479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-754de0ad-bf65-4d28-a23c-c7490b73bd77 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.370479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-754de0ad-bf65-4d28-a23c-c7490b73bd77" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.370479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-754de0ad-bf65-4d28-a23c-c7490b73bd77" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.370479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-754de0ad-bf65-4d28-a23c-c7490b73bd77" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.370479] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('754de0ad-bf65-4d28-a23c-c7490b73bd77',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.408326] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bedfe57-d892-4069-95fe-04362f6c6f25 [ 719.408897] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.408897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.409930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.410204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.410296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.410510] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bedfe57-d892-4069-95fe-04362f6c6f25 already deleted. [ 719.410510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bedfe57-d892-4069-95fe-04362f6c6f25" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.675244] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: SUCCESS [ 719.675645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.875521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.875680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.875846] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 754de0ad-bf65-4d28-a23c-c7490b73bd77 with status ACTIVE [ 719.876036] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.876150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.876217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.876423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.876535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.876707] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.876810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.876875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.877040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.877125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.877305] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.877403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.877462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.877601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.877674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.877758] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 754de0ad-bf65-4d28-a23c-c7490b73bd77 is going to be updated. [ 719.899056] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.899056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.899274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.899319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.899443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.899600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-754de0ad-bf65-4d28-a23c-c7490b73bd77" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.086825] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 720.087286] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 720.087533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.087638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.087893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.088833] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.088833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.088833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.089102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.089102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.089529] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.594444] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.668971] env[66157]: INFO networking_nsxv3.common.synchronization [None req-44144ac6-667c-47b5-9ba5-c68bd35a99da None None] Enqueued Resource ID: 4d230e88-0710-49d6-9dd9-ce7a54dad095 with Priority: HIGHEST for action port [ 720.669555] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d230e88-0710-49d6-9dd9-ce7a54dad095 with Priority: HIGHEST for action port [ 720.674382] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d230e88-0710-49d6-9dd9-ce7a54dad095 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.674382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d230e88-0710-49d6-9dd9-ce7a54dad095" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.674556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d230e88-0710-49d6-9dd9-ce7a54dad095" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.674718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d230e88-0710-49d6-9dd9-ce7a54dad095" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.674798] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d230e88-0710-49d6-9dd9-ce7a54dad095',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.052795] env[66157]: INFO networking_nsxv3.common.synchronization [req-6b6ecefc-511f-4413-896c-79cad1b03812 req-1035fcff-fbb9-4061-aa2d-d8456feb1b54 tempest-ServerGroupTestJSON-722266852 tempest-ServerGroupTestJSON-722266852-project-member] Enqueued Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGHEST for action security_group_members [ 721.052795] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGHEST for action security_group_members [ 721.052795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-49906db7-3f5d-403d-a6f1-f890089ce428 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.052795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.052795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.055060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.055060] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.055060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.055060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.055060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.055060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.055060] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.097974] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.178980] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d230e88-0710-49d6-9dd9-ce7a54dad095 [ 721.179383] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.179745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.179925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.180801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.180980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.181166] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d230e88-0710-49d6-9dd9-ce7a54dad095 already deleted. [ 721.181317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d230e88-0710-49d6-9dd9-ce7a54dad095" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.403164] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.403450] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-423" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.403585] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-423" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.403943] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-423" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.404242] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.404435] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.404548] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.404760] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.404898] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.405109] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.405223] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.405338] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.405450] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.405555] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.405652] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.405776] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.427606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.427606] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.427606] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.427606] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-423" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.427967] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-9523646c-d820-4a58-9f41-50dbf5e99a92 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.427967] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-9523646c-d820-4a58-9f41-50dbf5e99a92" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.427967] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-9523646c-d820-4a58-9f41-50dbf5e99a92" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.428324] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-9523646c-d820-4a58-9f41-50dbf5e99a92" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.429215] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9523646c-d820-4a58-9f41-50dbf5e99a92',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.557402] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.557640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.557742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.558047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.558172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.558423] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.558562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.558654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.558886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.559016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.559152] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49906db7-3f5d-403d-a6f1-f890089ce428 already deleted. [ 721.559275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.599782] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.599946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.600030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.600254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.600342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.600443] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 721.651797] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.652171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.652343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.652750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.652860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.666768] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 721.935023] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.935023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.935023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.935023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.935023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.935023] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 9523646c-d820-4a58-9f41-50dbf5e99a92 not found, creating... [ 721.935023] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.935023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.935023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.935023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.935023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.935473] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.935473] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.935473] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.935473] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.935473] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.935473] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 9523646c-d820-4a58-9f41-50dbf5e99a92 is going to be created. [ 721.957637] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.957637] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.957637] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.957859] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.957929] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.958213] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-9523646c-d820-4a58-9f41-50dbf5e99a92" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.829176] env[66157]: INFO networking_nsxv3.common.synchronization [req-6b6ecefc-511f-4413-896c-79cad1b03812 req-6ac5c5f9-aed7-4cd3-bb90-ed2f3f83441c service nova] Enqueued Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGHEST for action security_group_rules [ 722.829432] env[66157]: INFO networking_nsxv3.common.synchronization [req-6b6ecefc-511f-4413-896c-79cad1b03812 req-6ac5c5f9-aed7-4cd3-bb90-ed2f3f83441c service nova] Enqueued Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGHEST for action security_group_members [ 722.829466] env[66157]: INFO networking_nsxv3.common.synchronization [req-6b6ecefc-511f-4413-896c-79cad1b03812 req-6ac5c5f9-aed7-4cd3-bb90-ed2f3f83441c service nova] Enqueued Resource ID: 9523646c-d820-4a58-9f41-50dbf5e99a92 with Priority: HIGHEST for action port [ 722.830688] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGHEST for action security_group_rules [ 722.831763] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGHEST for action security_group_members [ 722.831763] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9523646c-d820-4a58-9f41-50dbf5e99a92 with Priority: HIGHEST for action port [ 722.831763] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49906db7-3f5d-403d-a6f1-f890089ce428 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.831878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.831878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.832359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.832459] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.833891] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-49906db7-3f5d-403d-a6f1-f890089ce428 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.834887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.834887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.834887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.834887] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.834887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.834887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.834887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.834887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.835396] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.839439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9523646c-d820-4a58-9f41-50dbf5e99a92 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.839439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9523646c-d820-4a58-9f41-50dbf5e99a92" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.839439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9523646c-d820-4a58-9f41-50dbf5e99a92" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.839439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9523646c-d820-4a58-9f41-50dbf5e99a92" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.839439] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9523646c-d820-4a58-9f41-50dbf5e99a92',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.990683] env[66157]: INFO networking_nsxv3.common.synchronization [req-a7041fbf-600c-48c1-a396-0f73dc8d5f3d req-acd3d92e-1024-41df-9e63-3b06a1b1c1ab tempest-ServersAdminNegativeTestJSON-2016589142 tempest-ServersAdminNegativeTestJSON-2016589142-project-member] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 722.990966] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 722.991299] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.991532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.991532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.991728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.991907] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.992063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.992482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.992482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.992482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.992621] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.226614] env[66157]: INFO networking_nsxv3.common.synchronization [req-a65b695d-4731-42e3-a12c-01d63968de5a req-2d0b9ea8-b187-4f24-8d14-919e324e040c tempest-FloatingIPsAssociationTestJSON-1906195860 tempest-FloatingIPsAssociationTestJSON-1906195860-project-member] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 723.227133] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 723.227483] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.227625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.227776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.228009] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.228182] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.228316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.228409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.228613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.228738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.228836] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.335063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-49906db7-3f5d-403d-a6f1-f890089ce428 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.335423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.347026] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9523646c-d820-4a58-9f41-50dbf5e99a92 with status ACTIVE [ 723.347026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.347026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.347026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.347026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.347026] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9523646c-d820-4a58-9f41-50dbf5e99a92 is going to be updated. [ 723.347842] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.362198] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.362401] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.362513] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.362776] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.363058] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.363602] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.363602] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.363602] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.363804] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.363851] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.363940] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.364057] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.364154] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.364253] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.364348] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.364499] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.372124] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.372295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.372336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.372649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.372828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.373072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9523646c-d820-4a58-9f41-50dbf5e99a92" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.386158] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.386589] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.386589] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.386722] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.386932] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-f478d147-922f-4801-87f5-7808444003aa taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.388586] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-f478d147-922f-4801-87f5-7808444003aa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.388586] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-f478d147-922f-4801-87f5-7808444003aa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.388586] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-f478d147-922f-4801-87f5-7808444003aa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.388586] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f478d147-922f-4801-87f5-7808444003aa',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.495882] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.496281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.496383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.496750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.496926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.497351] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.497568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.497704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.498040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.498198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.498355] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 already deleted. [ 723.498533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.661983] env[66157]: INFO networking_nsxv3.common.synchronization [None req-2e8ace5e-c945-4771-be3b-40cb2608f95f None None] Enqueued Resource ID: 21ebe310-20c4-421b-88f6-3eeaf637cf36 with Priority: HIGHEST for action port [ 723.663219] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ebe310-20c4-421b-88f6-3eeaf637cf36 with Priority: HIGHEST for action port [ 723.663575] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-21ebe310-20c4-421b-88f6-3eeaf637cf36 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.663734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21ebe310-20c4-421b-88f6-3eeaf637cf36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.663800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21ebe310-20c4-421b-88f6-3eeaf637cf36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.664253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21ebe310-20c4-421b-88f6-3eeaf637cf36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.664253] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ebe310-20c4-421b-88f6-3eeaf637cf36',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.678509] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 723.678667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.679137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.679336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.679547] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.679671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.679738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.679891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.679968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.680063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.680154] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.730829] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.848519] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.890894] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.891188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.891373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.891994] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.892130] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.892336] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port f478d147-922f-4801-87f5-7808444003aa not found, creating... [ 723.892644] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.892851] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.892988] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.893301] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.893489] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.893858] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.894082] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.894239] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.894569] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.894738] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.894906] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: f478d147-922f-4801-87f5-7808444003aa is going to be created. [ 723.920110] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.924089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.924089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.924089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.924089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.924089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-f478d147-922f-4801-87f5-7808444003aa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.166278] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21ebe310-20c4-421b-88f6-3eeaf637cf36 [ 724.166558] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.166735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.166883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.167449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.167574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.167722] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21ebe310-20c4-421b-88f6-3eeaf637cf36 already deleted. [ 724.167822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21ebe310-20c4-421b-88f6-3eeaf637cf36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.182063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.182235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.182235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.182442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.182626] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.182759] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.182814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.183037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.183136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.183246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.183890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.183890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.183890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.183890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.183890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.184072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.184072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.184740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.184740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.184740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.184740] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.233281] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.351479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.351674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.351723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.351907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.351995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.352109] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49906db7-3f5d-403d-a6f1-f890089ce428 is going to be created. [ 724.376530] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.376703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.376751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.376967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.377149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.386926] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49906db7-3f5d-403d-a6f1-f890089ce428 in Status: UNINITIALIZED for 2s [ 724.686405] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7e2acfe-17af-4683-bd94-9fc47ded2886: rpc.has_security_group_logging(os_id): False [ 724.699021] env[66157]: INFO networking_nsxv3.common.synchronization [req-a7041fbf-600c-48c1-a396-0f73dc8d5f3d req-7449300f-f3c0-48de-846f-0eabe323823f service nova] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_rules [ 724.699021] env[66157]: INFO networking_nsxv3.common.synchronization [req-a7041fbf-600c-48c1-a396-0f73dc8d5f3d req-7449300f-f3c0-48de-846f-0eabe323823f service nova] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 724.699021] env[66157]: INFO networking_nsxv3.common.synchronization [req-a7041fbf-600c-48c1-a396-0f73dc8d5f3d req-7449300f-f3c0-48de-846f-0eabe323823f service nova] Enqueued Resource ID: f478d147-922f-4801-87f5-7808444003aa with Priority: HIGHEST for action port [ 724.699021] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_rules [ 724.699021] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 724.699021] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478d147-922f-4801-87f5-7808444003aa with Priority: HIGHEST for action port [ 724.699493] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.699834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.700094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.703144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.703144] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.703144] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.703144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.703144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.703144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.703144] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.703144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.703144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.703144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.703144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.703144] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.706968] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-f478d147-922f-4801-87f5-7808444003aa taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.707966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f478d147-922f-4801-87f5-7808444003aa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.707966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f478d147-922f-4801-87f5-7808444003aa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.708735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f478d147-922f-4801-87f5-7808444003aa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.708735] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f478d147-922f-4801-87f5-7808444003aa',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.710839] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.710839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.710839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.710839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.710839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.710839] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.710839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.710839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.710839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.711266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.711266] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.711266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.711266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.711397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.711429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.712274] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.712274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.712274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.712274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.712274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.712274] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 724.736554] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.736918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.737166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.737354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.737444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.737546] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 is going to be updated. [ 724.765689] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.765876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.765954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.766226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.766327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.776446] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: IN_PROGRESS for 2s [ 724.780615] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.780726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.780778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.780951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.781119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.795614] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 725.154592] env[66157]: INFO networking_nsxv3.common.synchronization [req-449fe452-c1ae-4027-aa67-8304041ea6dd req-197f9039-e8cd-4bf1-8cad-78ed7d3249e0 tempest-VolumesAssistedSnapshotsTest-581408467 tempest-VolumesAssistedSnapshotsTest-581408467-project-member] Enqueued Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_members [ 725.155609] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGHEST for action security_group_members [ 725.155958] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4877d5-58b5-4fb9-8430-89b4ff018611 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.156115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.156182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.156828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.157143] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.157260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.157328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.157709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.157783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.157951] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.214251] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.215188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.215291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.215441] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f478d147-922f-4801-87f5-7808444003aa with status ACTIVE [ 725.215598] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.215698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.215760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.215946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.216050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.216233] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.216304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.216352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.216495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.216582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.216782] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.216958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.216958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.217109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.217109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.217225] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f478d147-922f-4801-87f5-7808444003aa is going to be updated. [ 725.240753] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.240753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.240753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.241864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.241864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.241864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f478d147-922f-4801-87f5-7808444003aa" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.665601] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.665803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.665851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.666078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.666173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.666525] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.666652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.666652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.666907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.666988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.667093] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4877d5-58b5-4fb9-8430-89b4ff018611 is going to be updated. [ 725.701484] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.701725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.701834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.702039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.702186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.712244] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4877d5-58b5-4fb9-8430-89b4ff018611 in Status: IN_PROGRESS for 2s [ 725.720349] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.224785] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.224785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.224785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.224785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.224785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.224785] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be created. [ 726.251148] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.255022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.255022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.255022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.255022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.265933] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: UNINITIALIZED for 2s [ 726.397949] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49906db7-3f5d-403d-a6f1-f890089ce428 in Status: SUCCESS [ 726.398177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.398363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.398588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.398793] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.398905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.398983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.399144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.399224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.399320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.399416] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.788451] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: SUCCESS [ 726.789939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.825481] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 726.825905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.902189] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-49906db7-3f5d-403d-a6f1-f890089ce428 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.905036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.905036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.905036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.905036] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.905036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.905036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.905036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.905375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.905375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.905424] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-49906db7-3f5d-403d-a6f1-f890089ce428 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.905704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.905704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.905868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.906022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.906446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.906511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.906824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.906920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.907136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.907245] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.409612] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49906db7-3f5d-403d-a6f1-f890089ce428: rpc.has_security_group_logging(os_id): False [ 727.430789] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.430926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.430996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.431262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.432956] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.433282] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.433407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.433474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.433669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.433751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.433964] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.434133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.434625] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.434775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.435077] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49906db7-3f5d-403d-a6f1-f890089ce428 is going to be created. [ 727.532062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.532272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.532336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.532592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.532792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.547685] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49906db7-3f5d-403d-a6f1-f890089ce428 in Status: IN_PROGRESS for 2s [ 727.724676] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4877d5-58b5-4fb9-8430-89b4ff018611 in Status: SUCCESS [ 727.725473] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4877d5-58b5-4fb9-8430-89b4ff018611 deletion is rescheduled due to dependency. [ 727.725473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.201760] env[66157]: INFO networking_nsxv3.common.synchronization [req-c2bf6c51-b996-4316-9703-0ca27ad575d4 req-85344de8-6e87-4922-be3a-86057f3e1b6d tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_members [ 728.202197] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_members [ 728.202510] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.202615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.202683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.202917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.203158] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.203231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.203231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.203398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.203441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.203544] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.279249] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: SUCCESS [ 728.279249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.279249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.279249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.279249] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.279249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.279249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.279249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.279249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.279249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.279249] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.657933] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-869 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.658299] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.658299] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.658594] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.659059] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.659059] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.659198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.659311] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.659447] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.659646] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.659757] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.659860] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.659963] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.660078] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.660179] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.660318] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.680628] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.680810] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.680976] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.681174] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.681505] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-4ff320f0-4b0a-484d-81d0-0497bcbee623 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.681671] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-4ff320f0-4b0a-484d-81d0-0497bcbee623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.681787] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-4ff320f0-4b0a-484d-81d0-0497bcbee623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.682117] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-4ff320f0-4b0a-484d-81d0-0497bcbee623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.682252] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff320f0-4b0a-484d-81d0-0497bcbee623',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.706047] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.706313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.706313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.706507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.706604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.706811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.706916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.706973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.707141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.707221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.707307] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c already deleted. [ 728.707387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.782199] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.783188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.783188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.783188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.783188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.783188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.783188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.783410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.783500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.783641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.783847] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.783942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.783999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.784151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.784281] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.784365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.784420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.784574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.784646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.784722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.784808] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.185304] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.185691] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.185910] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.186344] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.186539] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.186778] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 4ff320f0-4b0a-484d-81d0-0497bcbee623 not found, creating... [ 729.187223] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.187480] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.187659] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.188347] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.188347] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.188498] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.188656] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.188939] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.188992] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.189118] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.189253] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 4ff320f0-4b0a-484d-81d0-0497bcbee623 is going to be created. [ 729.231405] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.231702] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.231791] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.232162] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.232533] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.232963] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-4ff320f0-4b0a-484d-81d0-0497bcbee623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.289024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83c10e8c-149e-450b-b827-98a5e9d401e0: rpc.has_security_group_logging(os_id): False [ 729.413022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.413022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.413022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.413022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.413630] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.413630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.413630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.413630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.413630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.413938] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be created. [ 729.504942] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.504942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.504942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.504942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.504942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.536232] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: IN_PROGRESS for 2s [ 729.562271] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49906db7-3f5d-403d-a6f1-f890089ce428 in Status: SUCCESS [ 729.562541] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.002938] env[66157]: INFO networking_nsxv3.common.synchronization [req-c2bf6c51-b996-4316-9703-0ca27ad575d4 req-67cff26d-3ee7-4750-a614-054e004e71d1 service nova] Enqueued Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_rules [ 730.003266] env[66157]: INFO networking_nsxv3.common.synchronization [req-c2bf6c51-b996-4316-9703-0ca27ad575d4 req-67cff26d-3ee7-4750-a614-054e004e71d1 service nova] Enqueued Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_members [ 730.003334] env[66157]: INFO networking_nsxv3.common.synchronization [req-c2bf6c51-b996-4316-9703-0ca27ad575d4 req-67cff26d-3ee7-4750-a614-054e004e71d1 service nova] Enqueued Resource ID: 4ff320f0-4b0a-484d-81d0-0497bcbee623 with Priority: HIGHEST for action port [ 730.007878] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_rules [ 730.008334] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_members [ 730.008334] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff320f0-4b0a-484d-81d0-0497bcbee623 with Priority: HIGHEST for action port [ 730.008486] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.008673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.008792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.009027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.009118] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.010136] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.010258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.010325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.010570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.010791] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.010852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.010885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.012072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.012072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.012072] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.013531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff320f0-4b0a-484d-81d0-0497bcbee623 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.013680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff320f0-4b0a-484d-81d0-0497bcbee623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.013751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff320f0-4b0a-484d-81d0-0497bcbee623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.014032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff320f0-4b0a-484d-81d0-0497bcbee623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.014151] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff320f0-4b0a-484d-81d0-0497bcbee623',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.052404] env[66157]: INFO networking_nsxv3.common.synchronization [req-f7247fb4-1af7-4db1-bb83-a4b58ab4ea58 req-38f37690-3b0c-40ea-82a2-c6b2f90ba361 tempest-DeleteServersAdminTestJSON-1142677805 tempest-DeleteServersAdminTestJSON-1142677805-project-member] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 730.055127] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGHEST for action security_group_members [ 730.055127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.055127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.055127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.055456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.055964] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.056123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.058230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.058230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.058230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.058230] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.516420] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.517522] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.517649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.518049] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ff320f0-4b0a-484d-81d0-0497bcbee623 with status ACTIVE [ 730.518275] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.518431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.518516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.518747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.518873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.519318] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.519318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.519701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.519701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.519755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.519999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.520179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.520295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.520449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.520623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.520742] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ff320f0-4b0a-484d-81d0-0497bcbee623 is going to be updated. [ 730.547380] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.547629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.547629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.548995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.548995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.548995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff320f0-4b0a-484d-81d0-0497bcbee623" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.563541] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.563713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.563764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.564271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.564398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.565799] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.565799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.565799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.565799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.565799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.565799] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 is going to be updated. [ 730.596525] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.596660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.596806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.597320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.597320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.606865] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: IN_PROGRESS for 2s [ 731.019962] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.272998] env[66157]: INFO networking_nsxv3.common.synchronization [req-10be8b63-f771-47a8-91fe-ff99058c5755 req-52f264df-377e-4f93-be50-5817cc62ade0 tempest-ServerAddressesTestJSON-989537595 tempest-ServerAddressesTestJSON-989537595-project-member] Enqueued Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGHEST for action security_group_members [ 731.273617] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGHEST for action security_group_members [ 731.273946] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-82429466-a5a1-4b39-8d12-17fe5aa80977 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.274176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.274265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.274626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.274802] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.274910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.274986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.275150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.275239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.275346] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.522227] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.522458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.522579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.522859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.523038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.523150] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c is going to be created. [ 731.550679] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: SUCCESS [ 731.551122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.557409] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.557601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.557697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.557984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.558247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.574942] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc8d54c1-30b0-4581-9d61-8b194199903c in Status: UNINITIALIZED for 2s [ 731.778138] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.778319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.778394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.778683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.778784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.779028] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.779145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.779209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.779390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.779465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.779553] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 already deleted. [ 731.779634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.944281] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.944509] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-361" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.944841] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-361" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.945064] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-361" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.945257] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.945397] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.945629] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.945804] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.945946] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.946190] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.946342] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.946525] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.946809] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.946919] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.948386] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.948986] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.974660] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.976086] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.976086] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.976086] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-361" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.976262] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.976459] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.976616] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.977259] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.977454] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1f8444c-6dc5-4917-b56a-8ab82f336d2c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.479921] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.480318] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.480414] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.481655] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.481655] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.481655] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port d1f8444c-6dc5-4917-b56a-8ab82f336d2c not found, creating... [ 732.481942] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.482293] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.482457] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.482761] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.484891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.485465] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.485751] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.485864] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.486299] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.486486] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.486728] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: d1f8444c-6dc5-4917-b56a-8ab82f336d2c is going to be created. [ 732.511584] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.511845] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.511990] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.512384] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.512785] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.513106] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.626069] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 in Status: SUCCESS [ 732.626320] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 deletion is rescheduled due to dependency. [ 732.626485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.217424] env[66157]: INFO networking_nsxv3.common.synchronization [req-10be8b63-f771-47a8-91fe-ff99058c5755 req-5485bf2d-3134-494f-96ec-da9d5aa2bf41 service nova] Enqueued Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGHEST for action security_group_rules [ 733.217587] env[66157]: INFO networking_nsxv3.common.synchronization [req-10be8b63-f771-47a8-91fe-ff99058c5755 req-5485bf2d-3134-494f-96ec-da9d5aa2bf41 service nova] Enqueued Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGHEST for action security_group_members [ 733.217712] env[66157]: INFO networking_nsxv3.common.synchronization [req-10be8b63-f771-47a8-91fe-ff99058c5755 req-5485bf2d-3134-494f-96ec-da9d5aa2bf41 service nova] Enqueued Resource ID: d1f8444c-6dc5-4917-b56a-8ab82f336d2c with Priority: HIGHEST for action port [ 733.217938] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGHEST for action security_group_rules [ 733.218074] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGHEST for action security_group_members [ 733.218167] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1f8444c-6dc5-4917-b56a-8ab82f336d2c with Priority: HIGHEST for action port [ 733.221352] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82429466-a5a1-4b39-8d12-17fe5aa80977 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.221468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.221534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.221794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.221873] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.222906] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-82429466-a5a1-4b39-8d12-17fe5aa80977 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.223034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.223100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.223338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.224397] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.225238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.225317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.225423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.225509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.225603] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.227488] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.227615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.227652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.227802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.227874] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1f8444c-6dc5-4917-b56a-8ab82f336d2c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.592021] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc8d54c1-30b0-4581-9d61-8b194199903c in Status: SUCCESS [ 733.592021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.592021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.592021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.592021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.592021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.592021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.592021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.592584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.592584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.592584] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.621094] env[66157]: INFO networking_nsxv3.common.synchronization [None req-610021cf-c77f-4ec0-99b9-8181cc1f71e3 None None] Enqueued Resource ID: a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac with Priority: HIGHEST for action port [ 733.622158] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac with Priority: HIGHEST for action port [ 733.622607] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.622783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.622882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.623228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.623317] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.728514] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.729728] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-82429466-a5a1-4b39-8d12-17fe5aa80977 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.730074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.730457] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1f8444c-6dc5-4917-b56a-8ab82f336d2c with status ACTIVE [ 733.730633] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.730755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.731536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.731536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.731536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.731536] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.731536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.731536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.731803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.731911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.732127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.732240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.732292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.732433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.732503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.732912] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1f8444c-6dc5-4917-b56a-8ab82f336d2c is going to be updated. [ 733.758020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.758886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.758886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.758886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.758886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.758886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1f8444c-6dc5-4917-b56a-8ab82f336d2c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.097270] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.128408] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac [ 734.128577] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.128652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.128691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.128903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.129115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.129115] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac already deleted. [ 734.129452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ae5bf1-252a-46d9-9bb8-bef7ca1eabac" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.234257] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.603502] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc8d54c1-30b0-4581-9d61-8b194199903c: rpc.has_security_group_logging(os_id): False [ 734.627716] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.627716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.627972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.628023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.628129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.628388] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.628559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.628649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.628823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.628931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.629078] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c is going to be created. [ 734.723938] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.723938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.723938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.723938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.723938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.736493] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.736704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.736831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.736966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.737117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.737159] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 is going to be created. [ 734.740834] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc8d54c1-30b0-4581-9d61-8b194199903c in Status: IN_PROGRESS for 2s [ 734.787652] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.787883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.787991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.789277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.789884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.809064] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 in Status: UNINITIALIZED for 2s [ 735.637615] env[66157]: INFO networking_nsxv3.common.synchronization [None req-193ce7ad-9f9c-4021-9e68-4cd5696bc77a None None] Enqueued Resource ID: e0dd8b9b-faaf-4450-b361-c98428efccc8 with Priority: HIGHEST for action port [ 735.640080] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0dd8b9b-faaf-4450-b361-c98428efccc8 with Priority: HIGHEST for action port [ 735.640080] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0dd8b9b-faaf-4450-b361-c98428efccc8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.640080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0dd8b9b-faaf-4450-b361-c98428efccc8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.640080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0dd8b9b-faaf-4450-b361-c98428efccc8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.640446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0dd8b9b-faaf-4450-b361-c98428efccc8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.640446] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0dd8b9b-faaf-4450-b361-c98428efccc8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.143742] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0dd8b9b-faaf-4450-b361-c98428efccc8 [ 736.144021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.144193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.144269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.144631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.144704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.144903] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0dd8b9b-faaf-4450-b361-c98428efccc8 already deleted. [ 736.145061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0dd8b9b-faaf-4450-b361-c98428efccc8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.642424] env[66157]: INFO networking_nsxv3.common.synchronization [None req-e350bf0e-bbe8-482e-a7c7-8e8e8f55b8a6 None None] Enqueued Resource ID: 0c0ce542-3a58-4c9d-918d-9c7148da05c6 with Priority: HIGHEST for action port [ 736.648159] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c0ce542-3a58-4c9d-918d-9c7148da05c6 with Priority: HIGHEST for action port [ 736.648419] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c0ce542-3a58-4c9d-918d-9c7148da05c6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.648757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c0ce542-3a58-4c9d-918d-9c7148da05c6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.648946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c0ce542-3a58-4c9d-918d-9c7148da05c6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.650319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c0ce542-3a58-4c9d-918d-9c7148da05c6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.650465] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c0ce542-3a58-4c9d-918d-9c7148da05c6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.728849] env[66157]: INFO networking_nsxv3.common.synchronization [req-ec852fa7-93a6-441b-a20f-dfaafd27ef70 req-0dbb53e7-26d6-43de-8895-4d29c70d8063 tempest-SecurityGroupRulesTestJSON-1254492643 tempest-SecurityGroupRulesTestJSON-1254492643-project-member] Enqueued Resource ID: c5d6a35e-cd62-496a-9357-59938ca02b0c with Priority: HIGHEST for action security_group_rules [ 736.729236] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5d6a35e-cd62-496a-9357-59938ca02b0c with Priority: HIGHEST for action security_group_rules [ 736.729653] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5d6a35e-cd62-496a-9357-59938ca02b0c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.729844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5d6a35e-cd62-496a-9357-59938ca02b0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.729910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5d6a35e-cd62-496a-9357-59938ca02b0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.730476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5d6a35e-cd62-496a-9357-59938ca02b0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.730577] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5d6a35e-cd62-496a-9357-59938ca02b0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.754630] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc8d54c1-30b0-4581-9d61-8b194199903c in Status: SUCCESS [ 736.754971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.773056] env[66157]: INFO networking_nsxv3.common.synchronization [req-a36f7a57-3eaf-43af-b03f-0fb50f91f169 req-405b2af4-7960-495d-b844-a5e0a0ffb923 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 736.773910] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 736.778412] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.778412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.778412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.778412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.778412] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.778412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.778412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.778412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.778412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.778412] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.832729] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 in Status: SUCCESS [ 736.832729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.832729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.832729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.833074] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.833074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.833156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.833366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.833449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.833571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.833635] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.157275] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c0ce542-3a58-4c9d-918d-9c7148da05c6 [ 737.157275] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.157275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.157275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.157275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.157275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.157275] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c0ce542-3a58-4c9d-918d-9c7148da05c6 already deleted. [ 737.157275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c0ce542-3a58-4c9d-918d-9c7148da05c6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.213837] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.214147] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-207" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.214301] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-207" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.214646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-207" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.215015] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.215255] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.215373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.215610] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.215781] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.215936] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.216697] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.216697] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.216697] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.216697] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.216697] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.218663] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.250031] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.250257] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.250393] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.250605] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-207" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.250954] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-a907260d-797e-48d7-b33b-a43c83757182 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.251144] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.251329] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.251703] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.251789] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a907260d-797e-48d7-b33b-a43c83757182',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.260608] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.260608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.260815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.260936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.261064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.261177] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5d6a35e-cd62-496a-9357-59938ca02b0c already deleted. [ 737.261290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5d6a35e-cd62-496a-9357-59938ca02b0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.281816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.282033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.282150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.282393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.282557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.282964] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.283123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.283231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.283427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.283554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.283648] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 already deleted. [ 737.283742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.338341] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-82429466-a5a1-4b39-8d12-17fe5aa80977 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.338542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.338660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.339761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.339997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.340123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.340209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.340399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.340501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.340638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.340812] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-82429466-a5a1-4b39-8d12-17fe5aa80977 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.340909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.340968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.341162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.341398] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.341398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.341584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.341584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.341659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.341743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.341878] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.496062] env[66157]: INFO networking_nsxv3.common.synchronization [None req-60f85829-7591-4e68-ad3a-8d3e47ace636 tempest-MigrationsAdminTest-406320684 tempest-MigrationsAdminTest-406320684-project-member] Enqueued Resource ID: c60fe3e2-c4ee-4fc4-90e2-3eff91c89879 with Priority: HIGHEST for action security_group_rules [ 737.496924] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60fe3e2-c4ee-4fc4-90e2-3eff91c89879 with Priority: HIGHEST for action security_group_rules [ 737.497203] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.497571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.497571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.497871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.497981] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c60fe3e2-c4ee-4fc4-90e2-3eff91c89879',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.656265] env[66157]: INFO networking_nsxv3.common.synchronization [None req-25eea299-3f24-4b2f-8033-a593e81d6e69 tempest-MigrationsAdminTest-406320684 tempest-MigrationsAdminTest-406320684-project-member] Enqueued Resource ID: c60fe3e2-c4ee-4fc4-90e2-3eff91c89879 with Priority: HIGHEST for action security_group_rules [ 737.656880] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60fe3e2-c4ee-4fc4-90e2-3eff91c89879 with Priority: HIGHEST for action security_group_rules [ 737.657479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.657643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.754837] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.755362] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.755506] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.755928] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.756235] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.756487] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port a907260d-797e-48d7-b33b-a43c83757182 not found, creating... [ 737.756962] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.757349] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.757491] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.757836] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.757983] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.758397] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.758668] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.758865] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.759235] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.759451] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.759709] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: a907260d-797e-48d7-b33b-a43c83757182 is going to be created. [ 737.783317] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.783617] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.783617] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.783885] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.784147] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.784372] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.844274] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82429466-a5a1-4b39-8d12-17fe5aa80977: rpc.has_security_group_logging(os_id): False [ 737.864431] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.864677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.864677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.864928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.865037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.865248] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.865343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.865408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.865700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.865700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.866021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.866021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.866290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.866290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.866347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.866521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.866611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.866678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.866810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.866888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.866974] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 is going to be created. [ 737.954598] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.954847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.954962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.955283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.955567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.976954] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 in Status: IN_PROGRESS for 2s [ 738.044720] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.044720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.045061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.045061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.045180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.045307] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c60fe3e2-c4ee-4fc4-90e2-3eff91c89879 already deleted. [ 738.045450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.045703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.045969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.046561] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c60fe3e2-c4ee-4fc4-90e2-3eff91c89879',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.194314] env[66157]: INFO networking_nsxv3.common.synchronization [None req-39f5612d-0dc1-4bdf-8ba3-df59af23d66c None None] Enqueued Resource ID: 27ceae8f-4fad-459b-852b-b79f92a044fd with Priority: HIGHEST for action port [ 738.195742] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ceae8f-4fad-459b-852b-b79f92a044fd with Priority: HIGHEST for action port [ 738.197771] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-27ceae8f-4fad-459b-852b-b79f92a044fd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.197771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27ceae8f-4fad-459b-852b-b79f92a044fd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.197771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27ceae8f-4fad-459b-852b-b79f92a044fd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.197771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27ceae8f-4fad-459b-852b-b79f92a044fd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.197771] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27ceae8f-4fad-459b-852b-b79f92a044fd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.569620] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.569766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.569851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.570083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.570184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.570284] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c60fe3e2-c4ee-4fc4-90e2-3eff91c89879 already deleted. [ 738.570365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c60fe3e2-c4ee-4fc4-90e2-3eff91c89879" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.614417] env[66157]: INFO networking_nsxv3.common.synchronization [req-a36f7a57-3eaf-43af-b03f-0fb50f91f169 req-203407a5-bda5-476b-8e1e-418c983e4a50 service nova] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_rules [ 738.614417] env[66157]: INFO networking_nsxv3.common.synchronization [req-a36f7a57-3eaf-43af-b03f-0fb50f91f169 req-203407a5-bda5-476b-8e1e-418c983e4a50 service nova] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 738.614417] env[66157]: INFO networking_nsxv3.common.synchronization [req-a36f7a57-3eaf-43af-b03f-0fb50f91f169 req-203407a5-bda5-476b-8e1e-418c983e4a50 service nova] Enqueued Resource ID: a907260d-797e-48d7-b33b-a43c83757182 with Priority: HIGHEST for action port [ 738.615017] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_rules [ 738.615313] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 738.615732] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a907260d-797e-48d7-b33b-a43c83757182 with Priority: HIGHEST for action port [ 738.616453] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.616610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.617032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.617500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.617500] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.619456] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.619577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.619644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.619858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.620067] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.622924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.622924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.622924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.622924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.622924] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.622924] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a907260d-797e-48d7-b33b-a43c83757182 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.622924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.622924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.622924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.622924] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a907260d-797e-48d7-b33b-a43c83757182',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.701141] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27ceae8f-4fad-459b-852b-b79f92a044fd [ 738.701409] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.701409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.701564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.701804] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.702062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.702062] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27ceae8f-4fad-459b-852b-b79f92a044fd already deleted. [ 738.702167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27ceae8f-4fad-459b-852b-b79f92a044fd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.124073] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.124275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.124665] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.126431] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a907260d-797e-48d7-b33b-a43c83757182 with status ACTIVE [ 739.126710] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.127017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.127017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.127150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.127261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.127478] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.127629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.127629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.127815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.127952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.129030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.129030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.129030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.129030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.129030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.129030] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a907260d-797e-48d7-b33b-a43c83757182 is going to be updated. [ 739.163546] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.163546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.163546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.163757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.163882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.164149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.631496] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.706144] env[66157]: INFO networking_nsxv3.common.synchronization [req-45510b02-7c60-484b-b074-f9576eddf6d2 req-1a8530af-00ef-4eda-9b6c-b393f0580385 tempest-SecurityGroupRulesTestJSON-1254492643 tempest-SecurityGroupRulesTestJSON-1254492643-project-member] Enqueued Resource ID: fc97bb00-a0db-4964-86cc-3f914b891c18 with Priority: HIGHEST for action security_group_rules [ 739.706745] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc97bb00-a0db-4964-86cc-3f914b891c18 with Priority: HIGHEST for action security_group_rules [ 739.707222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc97bb00-a0db-4964-86cc-3f914b891c18 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.707352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc97bb00-a0db-4964-86cc-3f914b891c18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.707410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc97bb00-a0db-4964-86cc-3f914b891c18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.707662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc97bb00-a0db-4964-86cc-3f914b891c18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.707742] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc97bb00-a0db-4964-86cc-3f914b891c18',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.880315] env[66157]: INFO networking_nsxv3.common.synchronization [req-d285baac-28eb-4cb5-bda6-1cbb626ac29a req-b110f88b-5372-4773-af3c-6189eb0dfb68 tempest-ServerGroupTestJSON-722266852 tempest-ServerGroupTestJSON-722266852-project-member] Enqueued Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGHEST for action security_group_members [ 739.881416] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGHEST for action security_group_members [ 739.881754] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-49906db7-3f5d-403d-a6f1-f890089ce428 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.881924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.882094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.882332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.882552] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.882692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.882785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.884536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.884536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.884536] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.991813] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 in Status: SUCCESS [ 739.992063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.133507] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.133756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.133756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.133952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.134807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.134807] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be created. [ 740.162322] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.162322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.162322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.162322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.162322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.173391] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: UNINITIALIZED for 2s [ 740.228393] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.228544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.228615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.228831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.228928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.229041] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc97bb00-a0db-4964-86cc-3f914b891c18 already deleted. [ 740.229126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc97bb00-a0db-4964-86cc-3f914b891c18" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.390211] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.390546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.390546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.391052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.391164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.391511] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.391629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.391678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.391859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.391938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.392039] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49906db7-3f5d-403d-a6f1-f890089ce428 is going to be updated. [ 740.427291] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.427506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.428429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.428429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.428429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.440347] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49906db7-3f5d-403d-a6f1-f890089ce428 in Status: IN_PROGRESS for 2s [ 741.563023] env[66157]: INFO networking_nsxv3.common.synchronization [req-9ff95261-7e2b-4149-9294-de2c2ed6a048 req-6334a996-1cbc-4caf-95f4-7ad15b8ba633 tempest-SecurityGroupRulesTestJSON-1254492643 tempest-SecurityGroupRulesTestJSON-1254492643-project-member] Enqueued Resource ID: 57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc with Priority: HIGHEST for action security_group_rules [ 741.563538] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc with Priority: HIGHEST for action security_group_rules [ 741.563841] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.564000] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.565750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.566215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.566280] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.089775] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.089971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.090062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.090240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.090350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.090424] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc already deleted. [ 742.090520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57590f8a-3cbd-48d2-96ff-2c8e3f34b8fc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.184089] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: SUCCESS [ 742.184366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.184554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.184766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.184984] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.185154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.185227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.185398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.185579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.185628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.185790] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.454107] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49906db7-3f5d-403d-a6f1-f890089ce428 in Status: SUCCESS [ 742.454421] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49906db7-3f5d-403d-a6f1-f890089ce428 deletion is rescheduled due to dependency. [ 742.454604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.689139] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.689498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.689498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.689597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.689765] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.689890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.689949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.690139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.691201] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.691201] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.691201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.691596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.691596] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.194783] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49: rpc.has_security_group_logging(os_id): False [ 743.213255] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.213519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.213519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.213714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.213802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.214091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.214234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.214324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.214519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.214597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.214835] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.214975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.215064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.215247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.215350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.215582] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.215714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.215795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.215968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.216056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.216187] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be created. [ 743.290477] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.290629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.290730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.290937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.291158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.304895] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: IN_PROGRESS for 2s [ 743.793723] env[66157]: INFO networking_nsxv3.common.synchronization [req-9860589a-8274-4f0e-8927-fceb93b5b72e req-84edf3dd-103d-410a-a757-fa1bbd3bb930 tempest-SecurityGroupRulesTestJSON-1254492643 tempest-SecurityGroupRulesTestJSON-1254492643-project-member] Enqueued Resource ID: 1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a with Priority: HIGHEST for action security_group_rules [ 743.794180] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a with Priority: HIGHEST for action security_group_rules [ 743.794470] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.794591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.794659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.794904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.795404] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.046925] env[66157]: INFO networking_nsxv3.common.synchronization [req-7afbd956-1e83-41f4-bfd5-0f003e9a3475 req-ff3557fd-083f-49e5-8205-3a83dcd8020c tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 744.046925] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 744.047165] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.047288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.047355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.047559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.047717] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.047819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.047881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.048042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.048232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.048232] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.318266] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.318266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.318266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.318266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.318266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.318266] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a already deleted. [ 744.318266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1204ee6f-9bb8-4b9c-b3e0-bf465dcfce5a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.525207] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.525386] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.525560] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.525866] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.526232] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.527424] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.527424] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.527424] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.527424] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.527424] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.527424] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.527424] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.527688] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.527688] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.527796] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.528382] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.549521] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.550112] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.550112] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.550112] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.550779] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-3f60e223-810b-4526-9867-9ea24e16663c taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.550779] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-3f60e223-810b-4526-9867-9ea24e16663c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.550779] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-3f60e223-810b-4526-9867-9ea24e16663c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.551099] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-3f60e223-810b-4526-9867-9ea24e16663c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.551717] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f60e223-810b-4526-9867-9ea24e16663c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.553552] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.057954] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.058262] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.058332] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.058614] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.058757] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.058907] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 3f60e223-810b-4526-9867-9ea24e16663c not found, creating... [ 745.059194] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.059389] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.059450] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.059656] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.059786] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.060081] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.060232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.060338] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.060533] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.060660] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.060789] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 3f60e223-810b-4526-9867-9ea24e16663c is going to be created. [ 745.062794] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.084421] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.084421] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.084421] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.084644] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.085561] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.085561] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-3f60e223-810b-4526-9867-9ea24e16663c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.324301] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: SUCCESS [ 745.324301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.566289] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.566577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.566577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.566836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.566836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.566926] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 745.600737] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.600977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.601130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.601436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.601655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.612534] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 745.848961] env[66157]: INFO networking_nsxv3.common.synchronization [req-7afbd956-1e83-41f4-bfd5-0f003e9a3475 req-7f414aea-dbd4-47ca-bb46-d07e3f8bfe8b service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 745.849154] env[66157]: INFO networking_nsxv3.common.synchronization [req-7afbd956-1e83-41f4-bfd5-0f003e9a3475 req-7f414aea-dbd4-47ca-bb46-d07e3f8bfe8b service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 745.849290] env[66157]: INFO networking_nsxv3.common.synchronization [req-7afbd956-1e83-41f4-bfd5-0f003e9a3475 req-7f414aea-dbd4-47ca-bb46-d07e3f8bfe8b service nova] Enqueued Resource ID: 3f60e223-810b-4526-9867-9ea24e16663c with Priority: HIGHEST for action port [ 745.849823] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 745.849985] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 745.852951] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f60e223-810b-4526-9867-9ea24e16663c with Priority: HIGHEST for action port [ 745.854663] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.854882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.854936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.855212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.855302] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.856286] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.856403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.856892] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f60e223-810b-4526-9867-9ea24e16663c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.857015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f60e223-810b-4526-9867-9ea24e16663c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.857271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f60e223-810b-4526-9867-9ea24e16663c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.857271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f60e223-810b-4526-9867-9ea24e16663c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.857355] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f60e223-810b-4526-9867-9ea24e16663c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.364169] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.364591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.364591] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f60e223-810b-4526-9867-9ea24e16663c with status ACTIVE [ 746.364738] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.364738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.364879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.365099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.365164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.365375] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.365440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.365477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.365642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.365747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.367841] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.367841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.367841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.367841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.367841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.367841] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f60e223-810b-4526-9867-9ea24e16663c is going to be updated. [ 746.393553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.393731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.393773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.393972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.394128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.394290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f60e223-810b-4526-9867-9ea24e16663c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.749578] env[66157]: INFO networking_nsxv3.common.synchronization [req-88536bd3-f4d5-4ae7-801f-e4c0a9ad7b0a req-8ac651d6-c118-439a-8294-60b8753fe37d tempest-ServersTestManualDisk-850948594 tempest-ServersTestManualDisk-850948594-project-member] Enqueued Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_members [ 746.750242] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGHEST for action security_group_members [ 746.750608] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dca9267-bc95-42c2-accb-8a02b78bd970 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.750738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.750826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.751065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.751230] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.751340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.751421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.751604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.751705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.751820] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.209522] env[66157]: INFO networking_nsxv3.common.synchronization [req-68af1110-fe86-4f68-8ba9-2bbae7cff8a8 req-78b9b662-712d-48fe-9f31-dfe99341b40d tempest-ServerRescueTestJSON-1845946177 tempest-ServerRescueTestJSON-1845946177-project-member] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 747.210091] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 747.210386] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.210500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.210565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.210791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.210992] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.211486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.211715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.211775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.211861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.211958] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.254632] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.254840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.254937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.255267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.255909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.256521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.256521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.256625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.256814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.256923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.257057] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 is going to be updated. [ 747.291650] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.291650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.291650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.291997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.291997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.301856] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 in Status: IN_PROGRESS for 2s [ 747.489473] env[66157]: INFO networking_nsxv3.common.synchronization [None req-518b0a78-7b0b-4008-b132-e92a93bd1a47 None None] Enqueued Resource ID: a7989f94-3947-441b-a5cc-7f3325ab70cc with Priority: HIGHEST for action port [ 747.490783] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7989f94-3947-441b-a5cc-7f3325ab70cc with Priority: HIGHEST for action port [ 747.492812] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7989f94-3947-441b-a5cc-7f3325ab70cc taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.492998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7989f94-3947-441b-a5cc-7f3325ab70cc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.493096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7989f94-3947-441b-a5cc-7f3325ab70cc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.493447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7989f94-3947-441b-a5cc-7f3325ab70cc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.493533] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7989f94-3947-441b-a5cc-7f3325ab70cc',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.627497] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 747.627497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.627497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.627497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.627497] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.627497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.627497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.627497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.627497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.627497] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.704577] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-6 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.704785] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.704891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.705230] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.705485] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.705637] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.705806] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.705960] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.706176] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.706404] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.706516] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.706619] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.706721] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.706836] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.706941] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.707079] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.714016] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.729508] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.729700] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.729803] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.729981] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.730327] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-53b2a24b-8c80-4987-b889-0e2ec617f226 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.730635] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-53b2a24b-8c80-4987-b889-0e2ec617f226" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.730757] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-53b2a24b-8c80-4987-b889-0e2ec617f226" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.731355] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-53b2a24b-8c80-4987-b889-0e2ec617f226" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.731355] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53b2a24b-8c80-4987-b889-0e2ec617f226',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.996940] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7989f94-3947-441b-a5cc-7f3325ab70cc [ 747.997557] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.997557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.997557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.997790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.997790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.997851] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7989f94-3947-441b-a5cc-7f3325ab70cc already deleted. [ 747.997881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7989f94-3947-441b-a5cc-7f3325ab70cc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.130893] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.217205] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.234385] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.234646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.234771] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.235040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.235287] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.235407] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 53b2a24b-8c80-4987-b889-0e2ec617f226 not found, creating... [ 748.235666] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.235813] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.235924] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.236463] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.236463] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.236629] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.236768] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.236872] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.237079] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.237201] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.237334] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 53b2a24b-8c80-4987-b889-0e2ec617f226 is going to be created. [ 748.260818] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.261800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.261800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.261800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.261800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.262624] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-53b2a24b-8c80-4987-b889-0e2ec617f226" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.634834] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.722987] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.722987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.722987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.722987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.722987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.722987] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 is going to be updated. [ 748.752022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.752209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.752319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.752576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.752615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.763057] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: IN_PROGRESS for 2s [ 749.014852] env[66157]: INFO networking_nsxv3.common.synchronization [req-68af1110-fe86-4f68-8ba9-2bbae7cff8a8 req-652671bf-2e18-4631-a52b-fb8cc99496cf service nova] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_rules [ 749.015205] env[66157]: INFO networking_nsxv3.common.synchronization [req-68af1110-fe86-4f68-8ba9-2bbae7cff8a8 req-652671bf-2e18-4631-a52b-fb8cc99496cf service nova] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 749.015505] env[66157]: INFO networking_nsxv3.common.synchronization [req-68af1110-fe86-4f68-8ba9-2bbae7cff8a8 req-652671bf-2e18-4631-a52b-fb8cc99496cf service nova] Enqueued Resource ID: 53b2a24b-8c80-4987-b889-0e2ec617f226 with Priority: HIGHEST for action port [ 749.016342] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_rules [ 749.016380] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 749.016459] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53b2a24b-8c80-4987-b889-0e2ec617f226 with Priority: HIGHEST for action port [ 749.016772] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.016905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.016975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.017221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.017301] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.018385] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.018495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.018701] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-53b2a24b-8c80-4987-b889-0e2ec617f226 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.018805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53b2a24b-8c80-4987-b889-0e2ec617f226" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.018872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53b2a24b-8c80-4987-b889-0e2ec617f226" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.019076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53b2a24b-8c80-4987-b889-0e2ec617f226" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.019158] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53b2a24b-8c80-4987-b889-0e2ec617f226',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.142155] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.142407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.142495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.142776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.142894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.143046] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 749.195721] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.195904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.196152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.196344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.196344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.207648] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 749.317779] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 in Status: SUCCESS [ 749.318015] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 deletion is rescheduled due to dependency. [ 749.318264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.335943] env[66157]: INFO networking_nsxv3.common.synchronization [req-79f43174-f8af-42eb-937f-fd65af458205 req-b3a3ad1a-ab7b-40b4-922a-85ff8b01b1e3 tempest-SecurityGroupRulesTestJSON-1254492643 tempest-SecurityGroupRulesTestJSON-1254492643-project-member] Enqueued Resource ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 with Priority: HIGHEST for action security_group_rules [ 749.336718] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 with Priority: HIGHEST for action security_group_rules [ 749.337052] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.337162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.337286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.338845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.338845] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9a860e9-f6c1-42d9-9e09-8132421c60c9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.522228] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.522470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.522744] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53b2a24b-8c80-4987-b889-0e2ec617f226 with status ACTIVE [ 749.522961] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.523115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.523196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.523623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.523623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.523749] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.523845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.523905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.524150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.524248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.524468] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.524579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.524666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.524840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.524921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.525032] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53b2a24b-8c80-4987-b889-0e2ec617f226 is going to be updated. [ 749.549755] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.549755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.549755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.549755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.550061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.550092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53b2a24b-8c80-4987-b889-0e2ec617f226" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.862252] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.862599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.862599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.862992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.862992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.862992] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 already deleted. [ 749.863277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.899498] env[66157]: INFO networking_nsxv3.common.synchronization [None req-6ce9d87e-5369-4f12-a2a6-5549db196d2f None None] Enqueued Resource ID: 5d733940-734e-48b3-9667-def209437b73 with Priority: HIGHEST for action port [ 749.899498] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d733940-734e-48b3-9667-def209437b73 with Priority: HIGHEST for action port [ 749.899498] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d733940-734e-48b3-9667-def209437b73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.899498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d733940-734e-48b3-9667-def209437b73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.899498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d733940-734e-48b3-9667-def209437b73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.899960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d733940-734e-48b3-9667-def209437b73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.900104] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d733940-734e-48b3-9667-def209437b73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.149715] env[66157]: INFO networking_nsxv3.common.synchronization [req-f58b6990-c32f-4364-bad4-3f9b9698deec req-12378121-6ad2-46da-b219-46454901baf4 tempest-SecurityGroupRulesTestJSON-1254492643 tempest-SecurityGroupRulesTestJSON-1254492643-project-member] Enqueued Resource ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 with Priority: HIGHEST for action security_group_rules [ 750.149789] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 with Priority: HIGHEST for action security_group_rules [ 750.153068] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.153068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.153068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.153068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.153068] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9a860e9-f6c1-42d9-9e09-8132421c60c9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.403842] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d733940-734e-48b3-9667-def209437b73 [ 750.403842] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.403842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.403842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.403842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.403842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.403842] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d733940-734e-48b3-9667-def209437b73 already deleted. [ 750.403842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d733940-734e-48b3-9667-def209437b73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.606313] env[66157]: INFO networking_nsxv3.common.synchronization [req-e76549e0-d8c6-41e7-835f-aaf80ecda361 req-3d25e44d-7e01-4b06-800e-34f97127334d tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 750.606930] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 750.607668] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.607797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.607848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.608153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.608315] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.608410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.608470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.608616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.608701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.608792] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.675601] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.675918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.675918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.676085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.676364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.676364] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 already deleted. [ 750.676364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.776098] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: SUCCESS [ 750.776983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.776983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.777213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.777260] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.777418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.777489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.777875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.777875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.777875] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.040386] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.040946] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.040946] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.044918] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.045444] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.045709] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.046396] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.046396] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.046581] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.046885] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.047081] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.047263] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.047456] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.047656] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.047845] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.048734] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.079460] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.079460] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.079460] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.079460] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.079460] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-ab330087-20d8-48a4-850f-dd0b426be7b9 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.079460] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-ab330087-20d8-48a4-850f-dd0b426be7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.081391] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-ab330087-20d8-48a4-850f-dd0b426be7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.081915] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-ab330087-20d8-48a4-850f-dd0b426be7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.082271] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab330087-20d8-48a4-850f-dd0b426be7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.111325] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.112994] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.112994] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 already deleted. [ 751.112994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.218562] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 4s [ 751.280611] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.586194] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.586194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.586421] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.586544] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.586958] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.586958] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port ab330087-20d8-48a4-850f-dd0b426be7b9 not found, creating... [ 751.587105] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.587373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.587373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.587604] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.587756] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.588019] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.588165] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.588269] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.588462] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.588583] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.588709] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: ab330087-20d8-48a4-850f-dd0b426be7b9 is going to be created. [ 751.616465] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.616676] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.616792] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.617075] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.617317] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.617551] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-ab330087-20d8-48a4-850f-dd0b426be7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.782977] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.146824] env[66157]: INFO networking_nsxv3.common.synchronization [req-63de4ecf-c200-48fe-b05b-d93729c9b55d req-b97e743f-c56f-43cb-b954-7fefea3f4279 tempest-ServerAddressesTestJSON-989537595 tempest-ServerAddressesTestJSON-989537595-project-member] Enqueued Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGHEST for action security_group_members [ 752.147416] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGHEST for action security_group_members [ 752.147757] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-82429466-a5a1-4b39-8d12-17fe5aa80977 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.147889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.148793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.148793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.148793] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.148793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.149071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.149138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.149231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.149329] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.286828] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.286828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.286828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.286828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.286828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.286828] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 is going to be updated. [ 752.319246] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.319469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.319531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.319768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.319918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.331066] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: IN_PROGRESS for 2s [ 752.390016] env[66157]: INFO networking_nsxv3.common.synchronization [req-e76549e0-d8c6-41e7-835f-aaf80ecda361 req-578b9a17-53e4-4f21-b421-1fb4aa55eddf service nova] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 752.390319] env[66157]: INFO networking_nsxv3.common.synchronization [req-e76549e0-d8c6-41e7-835f-aaf80ecda361 req-578b9a17-53e4-4f21-b421-1fb4aa55eddf service nova] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 752.390523] env[66157]: INFO networking_nsxv3.common.synchronization [req-e76549e0-d8c6-41e7-835f-aaf80ecda361 req-578b9a17-53e4-4f21-b421-1fb4aa55eddf service nova] Enqueued Resource ID: ab330087-20d8-48a4-850f-dd0b426be7b9 with Priority: HIGHEST for action port [ 752.391482] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 752.391661] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 752.391790] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab330087-20d8-48a4-850f-dd0b426be7b9 with Priority: HIGHEST for action port [ 752.392289] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.392903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.392903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.392903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.392903] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.393876] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.394454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.394454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.394454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.394650] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.395186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.395324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.395528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.395700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.395900] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.398426] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab330087-20d8-48a4-850f-dd0b426be7b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.399649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab330087-20d8-48a4-850f-dd0b426be7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.399742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab330087-20d8-48a4-850f-dd0b426be7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.400060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab330087-20d8-48a4-850f-dd0b426be7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.400155] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab330087-20d8-48a4-850f-dd0b426be7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.543650] env[66157]: INFO networking_nsxv3.common.synchronization [req-51dfebb2-b053-4514-a45b-884d4cd7c261 req-99a6371f-acf8-446f-9ce4-251da3f34055 tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 752.544415] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 752.544756] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.544958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.545048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.545307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.545500] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.545699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.545699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.545873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.546014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.546105] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.653041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.653041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.653041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.653638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.653917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.654104] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.654214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.654281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.654446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.654523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.654709] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 is going to be updated. [ 752.691018] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.691018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.691018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.691286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.691517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.702660] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 in Status: IN_PROGRESS for 2s [ 752.770297] env[66157]: INFO networking_nsxv3.common.synchronization [req-d9d84620-a4a9-47b9-b4a3-d801f39f6002 req-2459f3c0-5980-4eb4-a4dd-980271d07c21 tempest-SecurityGroupRulesTestJSON-1254492643 tempest-SecurityGroupRulesTestJSON-1254492643-project-member] Enqueued Resource ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 with Priority: HIGHEST for action security_group_rules [ 752.770297] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 with Priority: HIGHEST for action security_group_rules [ 752.770838] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.771248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.771444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.772340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.773087] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9a860e9-f6c1-42d9-9e09-8132421c60c9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.898960] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.905562] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab330087-20d8-48a4-850f-dd0b426be7b9 with status ACTIVE [ 752.905562] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.905562] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.905562] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.905562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.905562] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab330087-20d8-48a4-850f-dd0b426be7b9 is going to be updated. [ 752.908013] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.908323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.930194] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.930380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.930494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.930800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.930970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.931488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab330087-20d8-48a4-850f-dd0b426be7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.050069] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.050239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.050319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.050539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.050629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.050874] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.051018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.051066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.051267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.051304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.051380] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 753.086558] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.086742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.086822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.087192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.087357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.104597] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 753.230938] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 753.231323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.231599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.233953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.233953] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.233953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.233953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.233953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.233953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.233953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.233953] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.306535] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.306710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.306766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.307152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.307284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.307431] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9a860e9-f6c1-42d9-9e09-8132421c60c9 already deleted. [ 753.307520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9a860e9-f6c1-42d9-9e09-8132421c60c9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.402241] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.737154] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.737483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.737709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.738063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.738347] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.738667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.738848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.739119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.739304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.739568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.741020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.741020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.741020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.741020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.741020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.741020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.741020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.741020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.741020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.741020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.741557] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.905862] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.905991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.906111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.906315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.906469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.906533] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be created. [ 753.934214] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.934214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.934214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.934464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.934464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.946727] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: UNINITIALIZED for 2s [ 754.244408] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 754.269039] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.269210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.269257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.270125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.270125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.270125] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.270125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.270125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.270464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.270464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.270620] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.270758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.270758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.271044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.271044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.271870] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.271870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.271870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.271870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.271870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.271870] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 754.354327] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: SUCCESS [ 754.356732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.356732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.356732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.356732] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.356732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.356732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.356732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.356732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.356732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.356732] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.385827] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.386033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.386091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.386312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.386464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.405919] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 754.713824] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 in Status: SUCCESS [ 754.714241] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 deletion is rescheduled due to dependency. [ 754.714337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.859512] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.859674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.859747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.859967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.860146] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.860244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.860316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.860447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.860530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.860614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.860753] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.860842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.860899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.861046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.861178] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.861265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.861354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.861449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.861524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.861604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.862122] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.114757] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 755.114757] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 755.114757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.366117] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa17bf86-d9f7-4a25-9da0-fb074266f0a1: rpc.has_security_group_logging(os_id): False [ 755.384217] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.384360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.384467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.384652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.384750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.384929] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.385040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.385130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.385494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.385494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.385615] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.385773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.385773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.385961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.386091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.386343] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.386648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.386715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.386849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.386924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.387031] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 is going to be updated. [ 755.454764] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.454997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.455111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.455376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.455586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.473616] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: IN_PROGRESS for 2s [ 755.958385] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 755.960935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.960935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.960935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.960935] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.960935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.960935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.960935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.960935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.960935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.960935] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.424044] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 756.424449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.463572] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.968669] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2381db7b-1b29-4dfc-a6af-48c498e3e0b0: rpc.has_security_group_logging(os_id): False [ 756.989164] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.989417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.989528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.989874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.990018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.990393] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.990550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.990658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.990886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.991025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.991336] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be created. [ 757.084612] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.084612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.084612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.084612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.084612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.098225] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 757.494385] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: SUCCESS [ 757.494724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.748612] env[66157]: INFO networking_nsxv3.common.synchronization [req-79145165-e354-4922-ac5e-cf2a77f3da18 req-74ca31b5-760c-4ba6-85d6-ed8ef4fbf0a4 tempest-FloatingIPsAssociationTestJSON-1906195860 tempest-FloatingIPsAssociationTestJSON-1906195860-project-member] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 757.750679] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGHEST for action security_group_members [ 757.753071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.753071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.753071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.753071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.753071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.753071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.753071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.753071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.753071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.753071] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.257866] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.257866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.257866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.257866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.257866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.257866] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.257866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.257866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.257866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.257866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.258241] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 is going to be updated. [ 758.295772] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.295922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.296033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.296781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.296781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.309962] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: IN_PROGRESS for 2s [ 759.115105] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 759.115459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.327412] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13cfa8de-e28e-458d-8572-75b45f56b222 in Status: SUCCESS [ 760.327412] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 deletion is rescheduled due to dependency. [ 760.327412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.520026] env[66157]: INFO networking_nsxv3.common.synchronization [req-37ecfc71-1524-459e-98bc-376549708e6f req-82572387-0f60-4156-8324-dadacf9fb81b tempest-InstanceActionsTestJSON-182881309 tempest-InstanceActionsTestJSON-182881309-project-member] Enqueued Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGHEST for action security_group_members [ 760.520740] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGHEST for action security_group_members [ 760.521162] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b48ccef-7f9a-4d48-8b46-294031485bbd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.522044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.522044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.522044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.522044] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.522044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.522516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.522516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.522516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.522794] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.895184] env[66157]: INFO networking_nsxv3.common.synchronization [None req-6b6eba39-ab3a-4dec-9818-f869408506d5 None None] Enqueued Resource ID: 033e0ff2-76a4-4b4d-9d56-a384eee2225b with Priority: HIGHEST for action port [ 760.895408] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 033e0ff2-76a4-4b4d-9d56-a384eee2225b with Priority: HIGHEST for action port [ 760.895956] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-033e0ff2-76a4-4b4d-9d56-a384eee2225b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.896275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-033e0ff2-76a4-4b4d-9d56-a384eee2225b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.896461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-033e0ff2-76a4-4b4d-9d56-a384eee2225b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.896907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-033e0ff2-76a4-4b4d-9d56-a384eee2225b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.898013] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('033e0ff2-76a4-4b4d-9d56-a384eee2225b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.025688] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.025863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.025958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.026187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.026320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.026502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.026913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.026913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.026913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.026913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.027112] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd already deleted. [ 761.027112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.049116] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-716 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.049364] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-716" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.049519] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-716" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.049918] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-716" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.050747] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.050989] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.051191] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.051479] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.051670] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.051945] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.052109] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.052339] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.052398] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.052530] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.052663] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.053294] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.073525] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.073701] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.073837] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.074021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-716" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.074336] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-01369238-f091-4fe0-a24b-57253eaa8d5c taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.074505] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-01369238-f091-4fe0-a24b-57253eaa8d5c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.074623] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-01369238-f091-4fe0-a24b-57253eaa8d5c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.074958] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-01369238-f091-4fe0-a24b-57253eaa8d5c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.075109] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01369238-f091-4fe0-a24b-57253eaa8d5c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.399853] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 033e0ff2-76a4-4b4d-9d56-a384eee2225b [ 761.399853] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.399853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.399853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.400236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.400236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.400236] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:033e0ff2-76a4-4b4d-9d56-a384eee2225b already deleted. [ 761.400348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-033e0ff2-76a4-4b4d-9d56-a384eee2225b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.578963] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.578963] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.578963] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.578963] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.578963] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.578963] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 01369238-f091-4fe0-a24b-57253eaa8d5c not found, creating... [ 761.578963] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.579438] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.579438] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.579438] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.579529] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.579806] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.579956] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.580009] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.580212] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.580339] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.580463] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 01369238-f091-4fe0-a24b-57253eaa8d5c is going to be created. [ 761.603287] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.603667] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.603819] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.604138] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.604375] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.604669] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-01369238-f091-4fe0-a24b-57253eaa8d5c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.328645] env[66157]: INFO networking_nsxv3.common.synchronization [req-37ecfc71-1524-459e-98bc-376549708e6f req-a6674a9e-22e8-42fd-b3e8-6157d6fde629 service nova] Enqueued Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGHEST for action security_group_rules [ 762.328645] env[66157]: INFO networking_nsxv3.common.synchronization [req-37ecfc71-1524-459e-98bc-376549708e6f req-a6674a9e-22e8-42fd-b3e8-6157d6fde629 service nova] Enqueued Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGHEST for action security_group_members [ 762.328645] env[66157]: INFO networking_nsxv3.common.synchronization [req-37ecfc71-1524-459e-98bc-376549708e6f req-a6674a9e-22e8-42fd-b3e8-6157d6fde629 service nova] Enqueued Resource ID: 01369238-f091-4fe0-a24b-57253eaa8d5c with Priority: HIGHEST for action port [ 762.329492] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGHEST for action security_group_rules [ 762.333239] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGHEST for action security_group_members [ 762.333239] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01369238-f091-4fe0-a24b-57253eaa8d5c with Priority: HIGHEST for action port [ 762.333239] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b48ccef-7f9a-4d48-8b46-294031485bbd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.333239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.333239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.333239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.333239] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.333239] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b48ccef-7f9a-4d48-8b46-294031485bbd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.333239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.333239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.333239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.333239] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.333239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.333239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.334763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.335601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.336132] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.339149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-01369238-f091-4fe0-a24b-57253eaa8d5c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.339467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01369238-f091-4fe0-a24b-57253eaa8d5c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.339646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01369238-f091-4fe0-a24b-57253eaa8d5c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.339994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01369238-f091-4fe0-a24b-57253eaa8d5c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.340222] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01369238-f091-4fe0-a24b-57253eaa8d5c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.689021] env[66157]: INFO networking_nsxv3.common.synchronization [req-792005dc-d2a4-47b6-94a2-fec8e8bdf3d0 req-1c440ad5-13d5-4492-a290-3c7fda4bd0e6 tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 762.689021] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 762.689021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.689021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.689021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.689021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.689757] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.690037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.690225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.691814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.691814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.691814] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.844435] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b48ccef-7f9a-4d48-8b46-294031485bbd taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.844587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.844791] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.845786] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01369238-f091-4fe0-a24b-57253eaa8d5c with status ACTIVE [ 762.847348] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.847348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.847348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.847348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.847348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.847348] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.847348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.847348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.847348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.847348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.849103] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.849256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.849328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.849489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.849567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.849653] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01369238-f091-4fe0-a24b-57253eaa8d5c is going to be updated. [ 762.873083] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.873286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.873335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.873572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.873752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.873921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01369238-f091-4fe0-a24b-57253eaa8d5c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.049195] env[66157]: INFO networking_nsxv3.common.synchronization [None req-010c3a6c-b67b-4a04-bc40-441b8ca31337 None None] Enqueued Resource ID: a8f50261-b08d-4c42-bb7c-9984725b0472 with Priority: HIGHEST for action port [ 763.049195] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8f50261-b08d-4c42-bb7c-9984725b0472 with Priority: HIGHEST for action port [ 763.049195] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8f50261-b08d-4c42-bb7c-9984725b0472 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.049195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8f50261-b08d-4c42-bb7c-9984725b0472" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.049195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8f50261-b08d-4c42-bb7c-9984725b0472" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.049575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8f50261-b08d-4c42-bb7c-9984725b0472" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.049792] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f50261-b08d-4c42-bb7c-9984725b0472',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.194667] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.351333] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.554211] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8f50261-b08d-4c42-bb7c-9984725b0472 [ 763.555078] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.555880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.555981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.556278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.556465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.556511] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8f50261-b08d-4c42-bb7c-9984725b0472 already deleted. [ 763.556594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8f50261-b08d-4c42-bb7c-9984725b0472" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.698277] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.855809] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.855955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.856667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.856667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.856667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.856667] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd is going to be created. [ 763.888088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.888371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.888463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.888681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.888900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.900057] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd in Status: UNINITIALIZED for 2s [ 764.206833] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.206833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.206833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.206833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.206833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.206833] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 764.250170] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.250364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.250449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.250689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.251592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.262963] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 765.058978] env[66157]: INFO networking_nsxv3.common.synchronization [req-35880912-c70b-4765-931f-b1a027c00814 req-b8a013e8-8ab3-4331-a0bb-aa141ec27597 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 with Priority: HIGHEST for action security_group_members [ 765.058978] env[66157]: INFO networking_nsxv3.common.synchronization [req-35880912-c70b-4765-931f-b1a027c00814 req-b8a013e8-8ab3-4331-a0bb-aa141ec27597 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 765.058978] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 with Priority: HIGHEST for action security_group_members [ 765.058978] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 765.058978] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3501fc85-25e9-457a-9d1c-f0134332afa7 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.058978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.058978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.058978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.058978] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.058978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.058978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.058978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.058978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.058978] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.061777] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.062403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.062605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.062870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.064418] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.064418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.064418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.064418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.064418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.064418] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.117449] env[66157]: INFO networking_nsxv3.common.synchronization [req-35880912-c70b-4765-931f-b1a027c00814 req-b8a013e8-8ab3-4331-a0bb-aa141ec27597 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 with Priority: HIGHEST for action security_group_rules [ 765.117576] env[66157]: INFO networking_nsxv3.common.synchronization [req-35880912-c70b-4765-931f-b1a027c00814 req-b8a013e8-8ab3-4331-a0bb-aa141ec27597 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 with Priority: HIGHEST for action security_group_members [ 765.117710] env[66157]: INFO networking_nsxv3.common.synchronization [req-35880912-c70b-4765-931f-b1a027c00814 req-b8a013e8-8ab3-4331-a0bb-aa141ec27597 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_rules [ 765.117835] env[66157]: INFO networking_nsxv3.common.synchronization [req-35880912-c70b-4765-931f-b1a027c00814 req-b8a013e8-8ab3-4331-a0bb-aa141ec27597 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 765.117956] env[66157]: INFO networking_nsxv3.common.synchronization [req-35880912-c70b-4765-931f-b1a027c00814 req-b8a013e8-8ab3-4331-a0bb-aa141ec27597 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: a907260d-797e-48d7-b33b-a43c83757182 with Priority: HIGHEST for action port [ 765.119357] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 with Priority: HIGHEST for action security_group_rules [ 765.119357] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_rules [ 765.119357] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a907260d-797e-48d7-b33b-a43c83757182 with Priority: HIGHEST for action port [ 765.119357] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 with Priority: HIGHEST for action security_group_members [ 765.119357] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 765.119357] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3501fc85-25e9-457a-9d1c-f0134332afa7 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.119726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.119726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.119726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.119819] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.121389] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.121389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.121389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.121389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.121389] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.122097] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a907260d-797e-48d7-b33b-a43c83757182 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.123220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.123220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.123220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.123220] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a907260d-797e-48d7-b33b-a43c83757182',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.123347] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3501fc85-25e9-457a-9d1c-f0134332afa7 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.123392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.123604] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.123664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.562994] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.566975] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.625486] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a907260d-797e-48d7-b33b-a43c83757182 with status ACTIVE [ 765.625771] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.625999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.626168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.626499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.626866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.627115] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.627299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.627421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.627717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.627992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.628223] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.628392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.628491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.628722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.628843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.629013] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a907260d-797e-48d7-b33b-a43c83757182 is going to be updated. [ 765.630852] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.631034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.631581] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3501fc85-25e9-457a-9d1c-f0134332afa7 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.631581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.660860] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.661107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.661107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.661272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.661435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.661599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.826844] env[66157]: INFO networking_nsxv3.common.synchronization [req-e4d2fb89-8889-4e4d-ac5d-bebeaf9a9fe5 req-f253b810-2a8a-4d15-8b0a-178f71c410bc tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 with Priority: HIGHEST for action security_group_members [ 765.826844] env[66157]: INFO networking_nsxv3.common.synchronization [req-e4d2fb89-8889-4e4d-ac5d-bebeaf9a9fe5 req-f253b810-2a8a-4d15-8b0a-178f71c410bc tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 765.827305] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 with Priority: HIGHEST for action security_group_members [ 765.827378] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 765.827674] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3501fc85-25e9-457a-9d1c-f0134332afa7 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.827788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.827951] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.828075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.886672] env[66157]: INFO networking_nsxv3.common.synchronization [req-e4d2fb89-8889-4e4d-ac5d-bebeaf9a9fe5 req-f253b810-2a8a-4d15-8b0a-178f71c410bc tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_rules [ 765.886672] env[66157]: INFO networking_nsxv3.common.synchronization [req-e4d2fb89-8889-4e4d-ac5d-bebeaf9a9fe5 req-f253b810-2a8a-4d15-8b0a-178f71c410bc tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 765.886672] env[66157]: INFO networking_nsxv3.common.synchronization [req-e4d2fb89-8889-4e4d-ac5d-bebeaf9a9fe5 req-f253b810-2a8a-4d15-8b0a-178f71c410bc tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: a907260d-797e-48d7-b33b-a43c83757182 with Priority: HIGHEST for action port [ 765.886672] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_rules [ 765.886672] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 765.886672] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a907260d-797e-48d7-b33b-a43c83757182 with Priority: HIGHEST for action port [ 765.886672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.886672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.886672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.886672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.886672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a907260d-797e-48d7-b33b-a43c83757182 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.886672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.886672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.886672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.887428] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a907260d-797e-48d7-b33b-a43c83757182',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.911646] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd in Status: SUCCESS [ 765.911861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.912442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.912613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.912811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.912937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.912984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.913159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.913244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.913333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.913422] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.065870] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.069431] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.275065] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 766.275353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.391544] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a907260d-797e-48d7-b33b-a43c83757182 with status ACTIVE [ 766.391779] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.391959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.392170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.392271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.392356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.392545] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.392645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.392716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.392854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.392933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.393135] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.393223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.393278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.393419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.393543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.393575] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a907260d-797e-48d7-b33b-a43c83757182 is going to be updated. [ 766.416071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.417258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.417258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.417258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.417258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.417258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a907260d-797e-48d7-b33b-a43c83757182" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.417258] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b48ccef-7f9a-4d48-8b46-294031485bbd taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.417258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.417564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.417564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.417711] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.417779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.417825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.417975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.418046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.418129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.418273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b48ccef-7f9a-4d48-8b46-294031485bbd taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.418379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.418427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.418547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.418679] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.418770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.418821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.419115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.419210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.419302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.419397] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.568719] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.568892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.568930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.569571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.569571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.569571] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 is going to be created. [ 766.573408] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.573734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.573734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.573976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.574064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.574137] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be updated. [ 766.610743] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.610952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.611146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.611405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.611585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.638624] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 in Status: UNINITIALIZED for 2s [ 766.640734] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.640955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.641066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.641326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.641615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.652387] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: IN_PROGRESS for 2s [ 766.921926] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b48ccef-7f9a-4d48-8b46-294031485bbd: rpc.has_security_group_logging(os_id): False [ 766.946639] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.947043] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.947442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.947442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.947747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.947999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.948311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.948459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.948699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.948844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.949148] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.949331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.949453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.949702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.949854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.950135] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.950351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.950476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.950700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.950843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.950990] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd is going to be created. [ 767.013438] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.013931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.014013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.014240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.014458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.026069] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd in Status: IN_PROGRESS for 2s [ 768.650947] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 in Status: SUCCESS [ 768.651319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.651358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.651576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.651761] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.651893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.651959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.652120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.652208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.652297] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.661080] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: SUCCESS [ 768.661291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.661448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.661705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.661893] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.662016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.662086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.662239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.662320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.662413] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.060983] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd in Status: SUCCESS [ 769.061232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.154960] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.155137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.155232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.155725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.155725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.155823] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.158038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.158038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.158038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.158038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.158038] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 is going to be deleted. [ 769.168388] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.197943] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.198190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.198311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.198529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.198621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.198720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.198932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.199116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.199285] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.199386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.199451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.199626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.199708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.199802] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.670435] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.703188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.703315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.703381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.703567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.703656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.703911] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.704012] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.704062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.704255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.704335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.704421] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 already deleted. [ 769.704500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.704597] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.705937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.707575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.708241] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.708370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.708417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.709779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.709779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.709779] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.175728] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.175728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.175728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.175728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.175728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.175728] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be updated. [ 770.212067] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.212067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.212067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.212067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.212067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.213552] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3501fc85-25e9-457a-9d1c-f0134332afa7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.215628] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.215943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.216140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.217871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.217871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.217871] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.217871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.217871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.217871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.217871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.217871] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 already deleted. [ 770.217871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.226659] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: IN_PROGRESS for 2s [ 770.319189] env[66157]: INFO networking_nsxv3.common.synchronization [None req-41c98f4c-aa98-4823-8a8c-2af432823f75 None None] Enqueued Resource ID: b3c78b06-6a6e-4186-87ed-0a5a8ef64c91 with Priority: HIGHEST for action port [ 770.319453] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3c78b06-6a6e-4186-87ed-0a5a8ef64c91 with Priority: HIGHEST for action port [ 770.320064] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3c78b06-6a6e-4186-87ed-0a5a8ef64c91 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.320235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3c78b06-6a6e-4186-87ed-0a5a8ef64c91" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.320235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3c78b06-6a6e-4186-87ed-0a5a8ef64c91" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.320438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3c78b06-6a6e-4186-87ed-0a5a8ef64c91" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.320522] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3c78b06-6a6e-4186-87ed-0a5a8ef64c91',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.717537] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3501fc85-25e9-457a-9d1c-f0134332afa7: rpc.has_security_group_logging(os_id): False [ 770.734930] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.734930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.734930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.735088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.735227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.735435] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.735483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.735548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.735689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.735760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.735904] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 is going to be created. [ 770.757320] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3501fc85-25e9-457a-9d1c-f0134332afa7], does not exist path=[/infra/domains/default/groups/3501fc85-25e9-457a-9d1c-f0134332afa7]."\n}' [ 770.757483] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3501fc85-25e9-457a-9d1c-f0134332afa7 [ 770.757599] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 770.794222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.795027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.795027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.795027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.796867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.797283] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.797440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.797536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.797767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.797881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.798197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.798283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.798445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.798642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.798765] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.798765] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3501fc85-25e9-457a-9d1c-f0134332afa7 is going to be created. [ 770.818060] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3501fc85-25e9-457a-9d1c-f0134332afa7], does not exist path=[/infra/domains/default/groups/3501fc85-25e9-457a-9d1c-f0134332afa7]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3501fc85-25e9-457a-9d1c-f0134332afa7 [ 770.818060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3501fc85-25e9-457a-9d1c-f0134332afa7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.818060] env[66157]: Traceback (most recent call last): [ 770.818060] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 770.818060] env[66157]: return func(*args, **kwargs) [ 770.818060] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 770.818060] env[66157]: res.raise_for_status() [ 770.818060] env[66157]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 770.818060] env[66157]: raise HTTPError(http_error_msg, response=self) [ 770.818060] env[66157]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3501fc85-25e9-457a-9d1c-f0134332afa7 [ 770.818060] env[66157]: During handling of the above exception, another exception occurred: [ 770.818060] env[66157]: Traceback (most recent call last): [ 770.818060] env[66157]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 770.818060] env[66157]: listener.cb(fileno) [ 770.818060] env[66157]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 770.818060] env[66157]: result = function(*args, **kwargs) [ 770.818060] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 770.818060] env[66157]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 770.818060] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 770.818060] env[66157]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 770.818060] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 770.818060] env[66157]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 770.818060] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 770.818060] env[66157]: res.raise_for_status() [ 770.818060] env[66157]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 770.818060] env[66157]: raise HTTPError(http_error_msg, response=self) [ 770.818060] env[66157]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3501fc85-25e9-457a-9d1c-f0134332afa7 [ 770.818060] env[66157]: Removing descriptor: 5 [ 770.824647] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3c78b06-6a6e-4186-87ed-0a5a8ef64c91 [ 770.824867] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.824996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.825085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.825297] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.825378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.825475] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3c78b06-6a6e-4186-87ed-0a5a8ef64c91 already deleted. [ 770.825554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3c78b06-6a6e-4186-87ed-0a5a8ef64c91" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.879238] env[66157]: INFO networking_nsxv3.common.synchronization [req-1a422527-144a-49cb-80fb-b2fdf6691225 req-11a64e48-8c73-4309-ac80-ae2f4a375a66 tempest-SecurityGroupRulesNegativeTestJSON-1277113081 tempest-SecurityGroupRulesNegativeTestJSON-1277113081-project-member] Enqueued Resource ID: 87f830cb-ced4-4f9d-8a53-ba35888dc243 with Priority: HIGHEST for action security_group_rules [ 771.879760] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87f830cb-ced4-4f9d-8a53-ba35888dc243 with Priority: HIGHEST for action security_group_rules [ 771.880255] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87f830cb-ced4-4f9d-8a53-ba35888dc243 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.880390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87f830cb-ced4-4f9d-8a53-ba35888dc243" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.880459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87f830cb-ced4-4f9d-8a53-ba35888dc243" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.880747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87f830cb-ced4-4f9d-8a53-ba35888dc243" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.880800] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87f830cb-ced4-4f9d-8a53-ba35888dc243',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.236944] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: SUCCESS [ 772.237198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.237376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.237582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.237763] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.237954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.238029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.238192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.238264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.238346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.238437] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.242538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.242538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.242538] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.242538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.242538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.242538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.242538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.242538] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.401435] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.401595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.401635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.401826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.405013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.405013] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87f830cb-ced4-4f9d-8a53-ba35888dc243 already deleted. [ 772.405013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87f830cb-ced4-4f9d-8a53-ba35888dc243" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.623411] env[66157]: INFO networking_nsxv3.common.synchronization [None req-2d13989b-3241-41f4-9542-6410c29e5d46 None None] Enqueued Resource ID: 83525cd1-b1ab-4ee8-8ad2-13c24876b4ff with Priority: HIGHEST for action port [ 772.623711] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83525cd1-b1ab-4ee8-8ad2-13c24876b4ff with Priority: HIGHEST for action port [ 772.626789] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-83525cd1-b1ab-4ee8-8ad2-13c24876b4ff taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.628058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83525cd1-b1ab-4ee8-8ad2-13c24876b4ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.628147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83525cd1-b1ab-4ee8-8ad2-13c24876b4ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.628480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83525cd1-b1ab-4ee8-8ad2-13c24876b4ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.628573] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83525cd1-b1ab-4ee8-8ad2-13c24876b4ff',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.744300] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.744436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.744650] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.906907] env[66157]: INFO networking_nsxv3.common.synchronization [req-14c8fe2b-b0b2-4e91-9dfa-96150214e58a req-51e87056-b066-411d-9127-5371a61ab572 tempest-SecurityGroupRulesNegativeTestJSON-1277113081 tempest-SecurityGroupRulesNegativeTestJSON-1277113081-project-member] Enqueued Resource ID: 87f830cb-ced4-4f9d-8a53-ba35888dc243 with Priority: HIGHEST for action security_group_rules [ 772.907561] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87f830cb-ced4-4f9d-8a53-ba35888dc243 with Priority: HIGHEST for action security_group_rules [ 772.907820] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87f830cb-ced4-4f9d-8a53-ba35888dc243 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.910642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87f830cb-ced4-4f9d-8a53-ba35888dc243" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.910949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87f830cb-ced4-4f9d-8a53-ba35888dc243" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.911029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87f830cb-ced4-4f9d-8a53-ba35888dc243" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.911110] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87f830cb-ced4-4f9d-8a53-ba35888dc243',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.131708] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83525cd1-b1ab-4ee8-8ad2-13c24876b4ff [ 773.131950] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.132102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.132171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.132384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.132476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.132572] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83525cd1-b1ab-4ee8-8ad2-13c24876b4ff already deleted. [ 773.132655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83525cd1-b1ab-4ee8-8ad2-13c24876b4ff" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.247492] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.432155] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.432301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.432560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.432791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.432886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.432986] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87f830cb-ced4-4f9d-8a53-ba35888dc243 already deleted. [ 773.433084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87f830cb-ced4-4f9d-8a53-ba35888dc243" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.749958] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.750104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.750218] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.750509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.750643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.750754] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be updated. [ 773.790018] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.790199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.790253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.790519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.790676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.802596] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: IN_PROGRESS for 2s [ 774.572505] env[66157]: INFO networking_nsxv3.common.synchronization [None req-3dffceea-476a-4626-b121-abdabc7041e3 None None] Enqueued Resource ID: 770ca134-30e8-4af2-a034-4417a26dad0c with Priority: HIGHEST for action port [ 774.573038] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 770ca134-30e8-4af2-a034-4417a26dad0c with Priority: HIGHEST for action port [ 774.573367] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-770ca134-30e8-4af2-a034-4417a26dad0c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.573486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-770ca134-30e8-4af2-a034-4417a26dad0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.573549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-770ca134-30e8-4af2-a034-4417a26dad0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.573819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-770ca134-30e8-4af2-a034-4417a26dad0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.573907] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('770ca134-30e8-4af2-a034-4417a26dad0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.580369] env[66157]: INFO networking_nsxv3.common.synchronization [req-43c1ba39-615c-4726-a964-804db10b84d7 req-1e279476-9217-4bf0-b0ce-96b6de6c0eab tempest-VolumesAdminNegativeTest-840301258 tempest-VolumesAdminNegativeTest-840301258-project-member] Enqueued Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGHEST for action security_group_members [ 774.580939] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGHEST for action security_group_members [ 774.581149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-65e20f28-433e-4752-bdc0-b5f939f691d0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.581268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.581334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.581611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.581773] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.581880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.581965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.582286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.582445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.582589] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.078760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 770ca134-30e8-4af2-a034-4417a26dad0c [ 775.079057] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.079282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.079406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.079630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.079718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.079815] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:770ca134-30e8-4af2-a034-4417a26dad0c already deleted. [ 775.079909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-770ca134-30e8-4af2-a034-4417a26dad0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.085379] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.085754] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-547" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.085914] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-547" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.086355] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-547" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.086805] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.087076] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.087251] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.087535] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.087703] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.087947] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.089065] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.089386] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.089467] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.089610] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.089715] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.089849] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.091401] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.091522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.091589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.091771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.091843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.092099] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.092379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.092379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.092379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.092619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.092619] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 already deleted. [ 775.092619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.112088] env[66157]: INFO networking_nsxv3.common.synchronization [req-9793a74e-ab82-43fa-8673-f54b8713dbde req-461f3929-3c59-426b-b08e-93a4ae00d8f7 tempest-ServerRescueTestJSONUnderV235-1018028231 tempest-ServerRescueTestJSONUnderV235-1018028231-project-member] Enqueued Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 775.113060] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 with Priority: HIGHEST for action security_group_members [ 775.113629] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.113728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.114821] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.115048] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.115230] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.115434] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-547" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.115762] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-b711e929-d12a-49b2-b7f5-dee7fd99f59e taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.115965] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-b711e929-d12a-49b2-b7f5-dee7fd99f59e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.116165] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-b711e929-d12a-49b2-b7f5-dee7fd99f59e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.116595] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-b711e929-d12a-49b2-b7f5-dee7fd99f59e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.116773] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b711e929-d12a-49b2-b7f5-dee7fd99f59e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.619527] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.619844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.619890] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.621710] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.621710] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.621710] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port b711e929-d12a-49b2-b7f5-dee7fd99f59e not found, creating... [ 775.621710] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.621931] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.621965] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.622221] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.622361] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.622646] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.622895] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.622895] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.623155] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.623529] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.623529] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: b711e929-d12a-49b2-b7f5-dee7fd99f59e is going to be created. [ 775.645652] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.645652] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.645778] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.646031] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.646275] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.646844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-b711e929-d12a-49b2-b7f5-dee7fd99f59e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.815309] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: SUCCESS [ 775.815531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.815710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.815926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.816181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.816300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.816362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.816523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.816606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.816700] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.153483] env[66157]: INFO networking_nsxv3.common.synchronization [req-9042a1ba-6233-41e4-9e21-7522418dbf00 req-7f8b70b1-99db-495b-9fde-fd88cf0dc17c tempest-ImagesOneServerTestJSON-1802965392 tempest-ImagesOneServerTestJSON-1802965392-project-member] Enqueued Resource ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c with Priority: HIGHEST for action security_group_members [ 776.154089] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c with Priority: HIGHEST for action security_group_members [ 776.154523] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a38d5e1a-6785-4c65-98b8-9c43e55d070c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.154697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.154803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.157772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.157993] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.158109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.158177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.158510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.158627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.158741] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a38d5e1a-6785-4c65-98b8-9c43e55d070c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.319571] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.319711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.319878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.320135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.353119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.353414] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.353563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.353918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.354158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.354320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.354428] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be updated. [ 776.393298] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.393298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.393298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.393298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.393298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.401860] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: IN_PROGRESS for 2s [ 776.443639] env[66157]: INFO networking_nsxv3.common.synchronization [req-43c1ba39-615c-4726-a964-804db10b84d7 req-07cf65dc-5eaa-462b-a3fb-798f737777a2 service nova] Enqueued Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGHEST for action security_group_rules [ 776.443829] env[66157]: INFO networking_nsxv3.common.synchronization [req-43c1ba39-615c-4726-a964-804db10b84d7 req-07cf65dc-5eaa-462b-a3fb-798f737777a2 service nova] Enqueued Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGHEST for action security_group_members [ 776.444073] env[66157]: INFO networking_nsxv3.common.synchronization [req-43c1ba39-615c-4726-a964-804db10b84d7 req-07cf65dc-5eaa-462b-a3fb-798f737777a2 service nova] Enqueued Resource ID: b711e929-d12a-49b2-b7f5-dee7fd99f59e with Priority: HIGHEST for action port [ 776.444194] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGHEST for action security_group_rules [ 776.444341] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGHEST for action security_group_members [ 776.444438] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b711e929-d12a-49b2-b7f5-dee7fd99f59e with Priority: HIGHEST for action port [ 776.445850] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65e20f28-433e-4752-bdc0-b5f939f691d0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.446046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.446148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.446439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.446529] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.447485] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-65e20f28-433e-4752-bdc0-b5f939f691d0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.447658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.447766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.448257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.448458] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.448593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.448672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.448835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.449044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.449126] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.451890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b711e929-d12a-49b2-b7f5-dee7fd99f59e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.452060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b711e929-d12a-49b2-b7f5-dee7fd99f59e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.452157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b711e929-d12a-49b2-b7f5-dee7fd99f59e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.452563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b711e929-d12a-49b2-b7f5-dee7fd99f59e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.452563] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b711e929-d12a-49b2-b7f5-dee7fd99f59e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.662881] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.663196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.663196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.663319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.687609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.687878] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.687997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.688088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.688596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.688679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.688771] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c is going to be updated. [ 776.741653] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.741846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.741846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.742080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.742230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.751344] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c in Status: IN_PROGRESS for 2s [ 776.792851] env[66157]: INFO networking_nsxv3.common.synchronization [None req-1ca795c9-42cc-4fb5-a6fd-83f632d53180 None None] Enqueued Resource ID: 7e46574e-4809-4a88-bafb-a5b72b90d578 with Priority: HIGHEST for action port [ 776.793573] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e46574e-4809-4a88-bafb-a5b72b90d578 with Priority: HIGHEST for action port [ 776.794343] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e46574e-4809-4a88-bafb-a5b72b90d578 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.794481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e46574e-4809-4a88-bafb-a5b72b90d578" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.794481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e46574e-4809-4a88-bafb-a5b72b90d578" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.795047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e46574e-4809-4a88-bafb-a5b72b90d578" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.795047] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e46574e-4809-4a88-bafb-a5b72b90d578',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.954279] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-65e20f28-433e-4752-bdc0-b5f939f691d0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.954403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.957294] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.957294] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b711e929-d12a-49b2-b7f5-dee7fd99f59e with status ACTIVE [ 776.957294] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.957294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.957294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.957294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.957294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.957294] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.957294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.957294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.957294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.957294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.957914] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.957914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.957914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.957914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.958040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.958040] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b711e929-d12a-49b2-b7f5-dee7fd99f59e is going to be updated. [ 776.989935] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.990101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.990167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.990785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.990785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.990785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b711e929-d12a-49b2-b7f5-dee7fd99f59e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.236865] env[66157]: INFO networking_nsxv3.common.synchronization [req-92036a7e-265f-40d4-9546-031d5ef10075 req-1359d4cd-51dc-496f-8995-a5e15a00396e tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 777.236865] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 777.236865] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.237427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.237670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.238016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.238987] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.239762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.239762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.239762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.239762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.239762] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.297838] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e46574e-4809-4a88-bafb-a5b72b90d578 [ 777.297838] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.297838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.297838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.298182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.298182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.298182] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e46574e-4809-4a88-bafb-a5b72b90d578 already deleted. [ 777.298271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e46574e-4809-4a88-bafb-a5b72b90d578" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.460921] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.713249] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.713676] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.713801] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.714245] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.714678] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.714947] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.715639] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.715639] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.715891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.716295] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.716485] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.716662] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.716831] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.717265] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.717476] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.717707] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.737371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.737504] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.737618] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.737787] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.738110] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-7c5970a8-d88b-401c-b083-f6f5da7b8024 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.738272] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-7c5970a8-d88b-401c-b083-f6f5da7b8024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.738526] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-7c5970a8-d88b-401c-b083-f6f5da7b8024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.738904] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-7c5970a8-d88b-401c-b083-f6f5da7b8024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.739067] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c5970a8-d88b-401c-b083-f6f5da7b8024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.742635] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.742821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.742938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.743197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.764404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.764657] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.764777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.764844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.765058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.765146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.765235] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 777.793793] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.793793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.793793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.794013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.794167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.803336] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 777.964018] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.965968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.965968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.965968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.965968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.965968] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 is going to be created. [ 777.991963] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.992386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.992473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.992739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.992907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.003518] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 in Status: UNINITIALIZED for 2s [ 778.241538] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.241782] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.241923] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.242208] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.242356] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.242501] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 7c5970a8-d88b-401c-b083-f6f5da7b8024 not found, creating... [ 778.242835] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.242915] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.242991] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.243217] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.243379] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.243654] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.243799] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.243907] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.244348] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.244526] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.244763] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 7c5970a8-d88b-401c-b083-f6f5da7b8024 is going to be created. [ 778.270652] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.270652] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.270652] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.272357] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.272357] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.272357] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-7c5970a8-d88b-401c-b083-f6f5da7b8024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.414486] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: SUCCESS [ 778.414486] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 deletion is rescheduled due to dependency. [ 778.414486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.414486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.414486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.414831] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.414831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.414831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.414950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.415319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.415319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.415319] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.415319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.415519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.415519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.415647] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.415741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.415860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.415922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.415993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.417029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.417029] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.418451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.418758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.418906] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.419013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.419082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.419225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.419302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.419388] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.762889] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c in Status: SUCCESS [ 778.764085] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a38d5e1a-6785-4c65-98b8-9c43e55d070c deletion is rescheduled due to dependency. [ 778.764085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a38d5e1a-6785-4c65-98b8-9c43e55d070c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.918875] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49: rpc.has_security_group_logging(os_id): False [ 778.923888] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.923888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.923888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.923888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.923888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.923888] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.923888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.923888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.923888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.923888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.923888] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be updated. [ 778.937361] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.937580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.937580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.937763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.938209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.938486] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.938586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.938650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.938812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.938888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.939098] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.939187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.939244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.939381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.939450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.939650] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.939897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.939897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.939986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.939986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.940324] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be updated. [ 778.952131] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.952131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.952131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.952131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.952131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.962105] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: IN_PROGRESS for 2s [ 778.984567] env[66157]: INFO networking_nsxv3.common.synchronization [req-92036a7e-265f-40d4-9546-031d5ef10075 req-83612894-6869-490b-a451-f10454dc11ba service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 778.984786] env[66157]: INFO networking_nsxv3.common.synchronization [req-92036a7e-265f-40d4-9546-031d5ef10075 req-83612894-6869-490b-a451-f10454dc11ba service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 778.984949] env[66157]: INFO networking_nsxv3.common.synchronization [req-92036a7e-265f-40d4-9546-031d5ef10075 req-83612894-6869-490b-a451-f10454dc11ba service nova] Enqueued Resource ID: 7c5970a8-d88b-401c-b083-f6f5da7b8024 with Priority: HIGHEST for action port [ 778.986230] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 778.986230] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 778.986230] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5970a8-d88b-401c-b083-f6f5da7b8024 with Priority: HIGHEST for action port [ 778.986230] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.986230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.986709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.986709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.986781] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.987766] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.987855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.988633] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c5970a8-d88b-401c-b083-f6f5da7b8024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.988727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c5970a8-d88b-401c-b083-f6f5da7b8024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.988762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c5970a8-d88b-401c-b083-f6f5da7b8024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.993273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c5970a8-d88b-401c-b083-f6f5da7b8024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.993273] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c5970a8-d88b-401c-b083-f6f5da7b8024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.016560] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.016733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.016783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.016968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.017132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.035589] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: IN_PROGRESS for 2s [ 779.493221] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.493361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.496803] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c5970a8-d88b-401c-b083-f6f5da7b8024 with status ACTIVE [ 779.497207] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.497509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.497631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.497907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.498019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.498391] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.498583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.498695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.498962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.499107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.499344] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.499489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.499559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.499770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.499897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.499940] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c5970a8-d88b-401c-b083-f6f5da7b8024 is going to be updated. [ 779.530616] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.530616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.530616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.530616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.530616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.530616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c5970a8-d88b-401c-b083-f6f5da7b8024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.814606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 779.814606] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef deletion is rescheduled due to dependency. [ 779.814606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.814979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.814979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.815081] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.815147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.815212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.815414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.815414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.815552] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.013824] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 in Status: SUCCESS [ 780.014155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.014342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.014599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.014843] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.015048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.015177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.015353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.015464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.015586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.015706] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.019660] env[66157]: INFO networking_nsxv3.common.synchronization [req-b82bbf07-a563-4557-9dc1-d0076e399c77 req-d8c2fa47-992b-411e-b4dd-0528e2b44353 tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 780.020274] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 780.020580] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.020707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.020774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.020917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.021168] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.021168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.021330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.021388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.021468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.021604] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.318336] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.434923] env[66157]: INFO networking_nsxv3.common.synchronization [req-b82bbf07-a563-4557-9dc1-d0076e399c77 req-11500a48-1f8b-40ce-8cb9-77f355bda0e2 tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 780.435490] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 780.435788] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.435886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.520713] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-65e20f28-433e-4752-bdc0-b5f939f691d0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.520931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.521028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.521191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.521362] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.521470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.521533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.521673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.521770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.521860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.522016] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-65e20f28-433e-4752-bdc0-b5f939f691d0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.522131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.522204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.522352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.522488] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.522579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.522642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.522774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.522851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.522934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.523033] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.524062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.524185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.524224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.524360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.546530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.546783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.546902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.546965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.547327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.547413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.547511] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 780.579025] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.579025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.579025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.579350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.579388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.591071] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 780.821463] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.974938] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: SUCCESS [ 780.975273] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 deletion is rescheduled due to dependency. [ 780.975273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.026666] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65e20f28-433e-4752-bdc0-b5f939f691d0: rpc.has_security_group_logging(os_id): False [ 781.045491] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.045662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.045714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.045941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.046055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.046264] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.046441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.046441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.046564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.046603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.046753] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.046990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.046990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.047090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.047223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.047350] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.047441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.047493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.047644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.047735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.047814] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 is going to be created. [ 781.049757] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 in Status: SUCCESS [ 781.049929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.050434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.050589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.050690] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.067075] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-866 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.067344] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-866" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.067549] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-866" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.067793] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-866" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.068140] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.068320] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.068520] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.068667] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.069608] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.069807] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 781.070454] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.070589] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.070700] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.070809] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 781.070911] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.071168] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.089497] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.089663] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 781.089812] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.089967] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-866" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.090306] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-b45d8b07-8e6b-4db4-b971-00a2fc655696 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.090597] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-b45d8b07-8e6b-4db4-b971-00a2fc655696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.090660] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-b45d8b07-8e6b-4db4-b971-00a2fc655696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.090981] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-b45d8b07-8e6b-4db4-b971-00a2fc655696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.091131] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b45d8b07-8e6b-4db4-b971-00a2fc655696',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.119491] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.119770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.119770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.119976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.120068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.132819] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 in Status: IN_PROGRESS for 2s [ 781.323585] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.323869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.323869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.324144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.324265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.324401] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 781.358098] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.358098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.358230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.358869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.358869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.368393] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 781.412487] env[66157]: INFO networking_nsxv3.common.synchronization [None req-c3efbe97-1d20-4264-9d9f-5d388ed0fdf9 None None] Enqueued Resource ID: 73fb39f8-0f56-4f1f-97dc-997999ec8d23 with Priority: HIGHEST for action port [ 781.413148] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fb39f8-0f56-4f1f-97dc-997999ec8d23 with Priority: HIGHEST for action port [ 781.413836] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-73fb39f8-0f56-4f1f-97dc-997999ec8d23 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.414080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73fb39f8-0f56-4f1f-97dc-997999ec8d23" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.414234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73fb39f8-0f56-4f1f-97dc-997999ec8d23" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.414495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73fb39f8-0f56-4f1f-97dc-997999ec8d23" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.414627] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73fb39f8-0f56-4f1f-97dc-997999ec8d23',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.569832] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.570057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.570057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.570230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.570329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.570430] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49 is going to be deleted. [ 781.593408] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.593742] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.593955] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.594412] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.594632] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.594836] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port b45d8b07-8e6b-4db4-b971-00a2fc655696 not found, creating... [ 781.595170] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.595397] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.595545] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.595824] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.596042] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.596797] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.596797] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.596797] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.597069] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.597069] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.597163] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: b45d8b07-8e6b-4db4-b971-00a2fc655696 is going to be created. [ 781.616819] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.617017] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.617218] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.617665] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.617914] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.618167] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-b45d8b07-8e6b-4db4-b971-00a2fc655696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.640162] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.640387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.640387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.640590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.640681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.640800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0bf9ebd-a87c-4c8b-af44-39edf8a0ad49" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.918407] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73fb39f8-0f56-4f1f-97dc-997999ec8d23 [ 781.918750] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.919215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.919215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.919215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.919381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.919381] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73fb39f8-0f56-4f1f-97dc-997999ec8d23 already deleted. [ 781.919504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73fb39f8-0f56-4f1f-97dc-997999ec8d23" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.449020] env[66157]: INFO networking_nsxv3.common.synchronization [req-b82bbf07-a563-4557-9dc1-d0076e399c77 req-4918081a-f0f2-41ef-847e-7104771d9890 service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 782.449166] env[66157]: INFO networking_nsxv3.common.synchronization [req-b82bbf07-a563-4557-9dc1-d0076e399c77 req-4918081a-f0f2-41ef-847e-7104771d9890 service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 782.449351] env[66157]: INFO networking_nsxv3.common.synchronization [req-b82bbf07-a563-4557-9dc1-d0076e399c77 req-4918081a-f0f2-41ef-847e-7104771d9890 service nova] Enqueued Resource ID: b45d8b07-8e6b-4db4-b971-00a2fc655696 with Priority: HIGHEST for action port [ 782.449804] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 782.453473] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 782.453473] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b45d8b07-8e6b-4db4-b971-00a2fc655696 with Priority: HIGHEST for action port [ 782.453473] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.453473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.453473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.453473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.453473] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.453473] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.453473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.453473] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b45d8b07-8e6b-4db4-b971-00a2fc655696 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.453473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b45d8b07-8e6b-4db4-b971-00a2fc655696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.453473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b45d8b07-8e6b-4db4-b971-00a2fc655696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.453473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b45d8b07-8e6b-4db4-b971-00a2fc655696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.453473] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b45d8b07-8e6b-4db4-b971-00a2fc655696',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.601310] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 782.602028] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 deletion is rescheduled due to dependency. [ 782.602028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.602028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.602178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.602356] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.602532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.602638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.602902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.602998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.603163] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.838294] env[66157]: INFO networking_nsxv3.common.synchronization [req-b5f2c623-3a72-4699-9dd5-1d957705b57f req-7ac28480-ef55-45fa-adcc-b6abf24e4a60 tempest-ServerRescueNegativeTestJSON-2006998581 tempest-ServerRescueNegativeTestJSON-2006998581-project-member] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 782.838870] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 782.841198] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.841363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.841434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.844048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.844263] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.844578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.844578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.844695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.844695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.844883] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.954441] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.954794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.958454] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b45d8b07-8e6b-4db4-b971-00a2fc655696 with status ACTIVE [ 782.958454] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.958783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.958949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.959220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.959357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.959772] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.959918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.959993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.960178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.960283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.960494] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.960592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.960661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.960805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.960882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.960967] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b45d8b07-8e6b-4db4-b971-00a2fc655696 is going to be updated. [ 782.984637] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.984789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.984843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.985072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.985210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.985366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b45d8b07-8e6b-4db4-b971-00a2fc655696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.108659] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.149362] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 in Status: SUCCESS [ 783.149589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.256614] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.256614] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.256860] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.257382] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.258022] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.258022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.258022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.258465] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.258465] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.258583] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.258638] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.259242] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.259242] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.259242] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.259242] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.259493] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.272067] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.272241] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-803" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.272331] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-803" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.272627] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-803" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.272887] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.273043] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.273161] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.273549] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.273549] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.273738] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.273827] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.273933] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.274043] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.274176] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.274316] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.274400] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.295380] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.295380] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.295380] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.295380] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.295380] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-5cef09d6-8627-43d0-9120-a07a099e4717 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.295380] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-5cef09d6-8627-43d0-9120-a07a099e4717" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.295380] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-5cef09d6-8627-43d0-9120-a07a099e4717" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.295787] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-5cef09d6-8627-43d0-9120-a07a099e4717" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.295787] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cef09d6-8627-43d0-9120-a07a099e4717',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.298393] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.298606] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.298796] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.299052] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-803" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.299562] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-dadb8d4e-3935-4bdc-b564-b0d072bded26 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.299846] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-dadb8d4e-3935-4bdc-b564-b0d072bded26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.300032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-dadb8d4e-3935-4bdc-b564-b0d072bded26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.300442] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-dadb8d4e-3935-4bdc-b564-b0d072bded26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.300579] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dadb8d4e-3935-4bdc-b564-b0d072bded26',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.349305] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.349542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.349635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.349846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.349944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.350653] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.350775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.350831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.351156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.351291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.351391] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 already deleted. [ 783.351538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.381322] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 783.381544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.381730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.382099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.382317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.382485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.382574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.382752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.382752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.382862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.382973] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.611498] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.799923] env[66157]: INFO networking_nsxv3.common.synchronization [None req-ce8bee25-75d2-4b10-83cf-6c8ddea57558 None None] Enqueued Resource ID: 002d811b-1fa7-405f-9e8a-a82d5157b7dd with Priority: HIGHEST for action port [ 783.800540] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002d811b-1fa7-405f-9e8a-a82d5157b7dd with Priority: HIGHEST for action port [ 783.800828] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-002d811b-1fa7-405f-9e8a-a82d5157b7dd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.800953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-002d811b-1fa7-405f-9e8a-a82d5157b7dd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.801032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-002d811b-1fa7-405f-9e8a-a82d5157b7dd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.801285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-002d811b-1fa7-405f-9e8a-a82d5157b7dd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.801372] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('002d811b-1fa7-405f-9e8a-a82d5157b7dd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.802444] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.803131] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.803131] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.803131] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.803131] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.803401] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 5cef09d6-8627-43d0-9120-a07a099e4717 not found, creating... [ 783.803562] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.803698] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.803802] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.804012] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.804156] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.804419] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.804813] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.804813] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.804950] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.804985] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.805110] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 5cef09d6-8627-43d0-9120-a07a099e4717 is going to be created. [ 783.806410] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.806570] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.806685] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.806883] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.807022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.807155] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port dadb8d4e-3935-4bdc-b564-b0d072bded26 not found, creating... [ 783.807416] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.807631] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.807665] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.807852] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.807974] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.808257] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.808400] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.808506] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.808765] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.808817] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.808933] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: dadb8d4e-3935-4bdc-b564-b0d072bded26 is going to be created. [ 783.836334] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.836457] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.836526] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.836790] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.837020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.837244] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-dadb8d4e-3935-4bdc-b564-b0d072bded26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.839282] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.839546] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.839689] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.839864] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.840017] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.840223] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-5cef09d6-8627-43d0-9120-a07a099e4717" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.886604] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.886817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.886974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.887213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.887607] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.887798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.887798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.888069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.888213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.888317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.888514] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.888768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.888862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.889058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.889235] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.889357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.889469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.889588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.889703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.889810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.890072] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.114238] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.114626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.114626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.114626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.114752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.114813] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 784.144743] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.144950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.144950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.145196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.145345] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.155212] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 784.311278] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 002d811b-1fa7-405f-9e8a-a82d5157b7dd [ 784.311521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.311655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.311723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.311946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.312048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.312166] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:002d811b-1fa7-405f-9e8a-a82d5157b7dd already deleted. [ 784.312233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-002d811b-1fa7-405f-9e8a-a82d5157b7dd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.393415] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4915dbf-d6e2-46dd-8508-11f50b8da0ef: rpc.has_security_group_logging(os_id): False [ 784.417193] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.417408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.417449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.417639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.417932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.418020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.418118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.418246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.418328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.418395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.418601] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.418740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.418809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.418973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.420393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.420634] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.420743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.420805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.420915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.420994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.424374] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 784.497636] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.497829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.497829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.498064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.498223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.519355] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 784.632757] env[66157]: INFO networking_nsxv3.common.synchronization [req-b82bbf07-a563-4557-9dc1-d0076e399c77 req-90523622-9307-4f18-88bb-f15affeecf0f service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 784.632757] env[66157]: INFO networking_nsxv3.common.synchronization [req-b82bbf07-a563-4557-9dc1-d0076e399c77 req-90523622-9307-4f18-88bb-f15affeecf0f service nova] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 784.632757] env[66157]: INFO networking_nsxv3.common.synchronization [req-b82bbf07-a563-4557-9dc1-d0076e399c77 req-90523622-9307-4f18-88bb-f15affeecf0f service nova] Enqueued Resource ID: dadb8d4e-3935-4bdc-b564-b0d072bded26 with Priority: HIGHEST for action port [ 784.632757] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_rules [ 784.632757] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 784.632757] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dadb8d4e-3935-4bdc-b564-b0d072bded26 with Priority: HIGHEST for action port [ 784.632757] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.632757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.632757] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.632757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.633134] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-dadb8d4e-3935-4bdc-b564-b0d072bded26 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.633134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dadb8d4e-3935-4bdc-b564-b0d072bded26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.633134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dadb8d4e-3935-4bdc-b564-b0d072bded26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.633262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dadb8d4e-3935-4bdc-b564-b0d072bded26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.633339] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dadb8d4e-3935-4bdc-b564-b0d072bded26',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.989812] env[66157]: INFO networking_nsxv3.common.synchronization [req-b5f2c623-3a72-4699-9dd5-1d957705b57f req-f9288a5a-fd26-445c-8a52-edf3a35b2757 service nova] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_rules [ 784.989974] env[66157]: INFO networking_nsxv3.common.synchronization [req-b5f2c623-3a72-4699-9dd5-1d957705b57f req-f9288a5a-fd26-445c-8a52-edf3a35b2757 service nova] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 784.990371] env[66157]: INFO networking_nsxv3.common.synchronization [req-b5f2c623-3a72-4699-9dd5-1d957705b57f req-f9288a5a-fd26-445c-8a52-edf3a35b2757 service nova] Enqueued Resource ID: 5cef09d6-8627-43d0-9120-a07a099e4717 with Priority: HIGHEST for action port [ 784.990371] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_rules [ 784.990526] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 784.990592] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cef09d6-8627-43d0-9120-a07a099e4717 with Priority: HIGHEST for action port [ 784.992300] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.992430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.992501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.992760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.992841] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.993696] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.993817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.993885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.994079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.994223] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.994321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.994384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.994525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.994612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.994698] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.995708] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cef09d6-8627-43d0-9120-a07a099e4717 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.995815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cef09d6-8627-43d0-9120-a07a099e4717" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.995883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cef09d6-8627-43d0-9120-a07a099e4717" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.997033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cef09d6-8627-43d0-9120-a07a099e4717" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.997033] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cef09d6-8627-43d0-9120-a07a099e4717',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.135159] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dadb8d4e-3935-4bdc-b564-b0d072bded26 with status ACTIVE [ 785.135467] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.135565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.135565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.135852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.135852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.136148] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.136384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.136454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.136613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.136693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.138276] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.138276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.138276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.138276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.138276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.138276] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dadb8d4e-3935-4bdc-b564-b0d072bded26 is going to be updated. [ 785.139666] env[66157]: INFO networking_nsxv3.common.synchronization [req-73b4cd48-b148-46dd-963a-0b2ce9f1c91b req-543e38f2-051c-4a6e-898c-1414dcc8be10 tempest-ServerRescueTestJSON-1845946177 tempest-ServerRescueTestJSON-1845946177-project-member] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 785.140238] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 785.141050] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.141175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.141253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.142382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.142382] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.142382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.142382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.142382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.142382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.142382] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.163630] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.163774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.163846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.164060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.164216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.164401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dadb8d4e-3935-4bdc-b564-b0d072bded26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.311177] env[66157]: INFO networking_nsxv3.common.synchronization [req-61bf45ac-c3e2-4f2b-a5d5-7dc2d91cec0b req-3771b898-b2c7-42e8-ac6d-c69be205bde8 tempest-InstanceActionsTestJSON-182881309 tempest-InstanceActionsTestJSON-182881309-project-member] Enqueued Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGHEST for action security_group_members [ 785.312588] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGHEST for action security_group_members [ 785.312588] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b48ccef-7f9a-4d48-8b46-294031485bbd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.312588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.312850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.312889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.313073] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.313178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.313240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.313421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.313518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.313630] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.465585] env[66157]: INFO networking_nsxv3.common.synchronization [None req-ae88d1c0-c3b5-422e-9b76-85d210356b7d tempest-ServersTestJSON-688042915 tempest-ServersTestJSON-688042915-project-member] Enqueued Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_rules [ 785.467383] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_rules [ 785.468243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b93b3d3-7a24-441f-88d0-38d5293ec145 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.468360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.468442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.468745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.468833] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.499362] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.499558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.500273] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.501552] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cef09d6-8627-43d0-9120-a07a099e4717 with status ACTIVE [ 785.501636] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.501779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.501870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.503107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.503831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.504303] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.504541] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.504689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.504907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.505968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.507391] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.507790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.507979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.509290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.509500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.509680] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cef09d6-8627-43d0-9120-a07a099e4717 is going to be updated. [ 785.512117] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.536571] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.536853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.536853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.537084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.537436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.537519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cef09d6-8627-43d0-9120-a07a099e4717" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.605631] env[66157]: INFO networking_nsxv3.common.synchronization [req-da8e7aa1-6abb-46ba-a346-3857407490fc req-08583af2-9306-4188-85a6-58407c87ee25 tempest-ServersAdminTestJSON-1739826864 tempest-ServersAdminTestJSON-1739826864-project-member] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 785.607301] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 785.607664] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.607813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.607890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.608119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.608273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.608403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.608457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.608639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.608738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.608869] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.644031] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.817956] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.818139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.818182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.819488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.820525] env[66157]: INFO networking_nsxv3.common.synchronization [None req-1ab23da7-62a8-49c0-bb7e-4399456796d9 tempest-ServersTestJSON-688042915 tempest-ServersTestJSON-688042915-project-member] Enqueued Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_rules [ 785.821210] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_rules [ 785.822090] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b93b3d3-7a24-441f-88d0-38d5293ec145 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.822253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.846379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.846653] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.846772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.846839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.847057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.847146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.847245] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd is going to be updated. [ 785.875907] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.876089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.876173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.876449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.876606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.885888] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd in Status: IN_PROGRESS for 2s [ 785.990303] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.990497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.990588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.991928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.992240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.992540] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 already deleted. [ 785.992540] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.992645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.992996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.992996] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.016155] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.016155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.016155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.016398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.016398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.016453] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be created. [ 786.045270] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.045478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.045725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.045799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.046107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.055788] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: UNINITIALIZED for 2s [ 786.108992] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.109363] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.109467] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.109755] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.110065] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.110364] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.110427] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.111065] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.111065] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.111168] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.111275] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.111388] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.111607] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.111642] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.112234] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.112234] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.113558] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.134934] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.135055] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.135187] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.135447] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-745" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.135738] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-15727094-ece5-4fb1-8322-671145325ae8 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.135967] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-15727094-ece5-4fb1-8322-671145325ae8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.136110] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-15727094-ece5-4fb1-8322-671145325ae8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.136479] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-15727094-ece5-4fb1-8322-671145325ae8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.136628] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15727094-ece5-4fb1-8322-671145325ae8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.146761] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.172739] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 786.172860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.173020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.173310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.173612] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.173612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.173767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.173802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.174187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.174187] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.522793] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.522957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.523028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.523254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.523346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.523463] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 already deleted. [ 786.523899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.535856] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 786.536202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.615833] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.639936] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.640176] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.640309] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.640653] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.640806] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.640998] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 15727094-ece5-4fb1-8322-671145325ae8 not found, creating... [ 786.641304] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.641490] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.641621] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.641880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.642049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.642355] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.642531] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.642653] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.642998] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.643048] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.643185] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 15727094-ece5-4fb1-8322-671145325ae8 is going to be created. [ 786.648978] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.649104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.649650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.649650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.649650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.649650] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 is going to be updated. [ 786.667720] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.668013] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.668189] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.668479] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.668797] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.669075] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-15727094-ece5-4fb1-8322-671145325ae8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.678705] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.679044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.679044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.679307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.679461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.680579] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.690905] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: IN_PROGRESS for 2s [ 787.120351] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.120522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.120579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.120785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.120886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.120983] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 787.153576] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.153576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.153576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.154166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.154166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.166380] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 787.183049] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.377997] env[66157]: INFO networking_nsxv3.common.synchronization [req-da8e7aa1-6abb-46ba-a346-3857407490fc req-59c0acf9-eecd-40f2-8925-092a4f13e9e3 service nova] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_rules [ 787.378207] env[66157]: INFO networking_nsxv3.common.synchronization [req-da8e7aa1-6abb-46ba-a346-3857407490fc req-59c0acf9-eecd-40f2-8925-092a4f13e9e3 service nova] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 787.378653] env[66157]: INFO networking_nsxv3.common.synchronization [req-da8e7aa1-6abb-46ba-a346-3857407490fc req-59c0acf9-eecd-40f2-8925-092a4f13e9e3 service nova] Enqueued Resource ID: 15727094-ece5-4fb1-8322-671145325ae8 with Priority: HIGHEST for action port [ 787.378893] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_rules [ 787.379059] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 787.379196] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15727094-ece5-4fb1-8322-671145325ae8 with Priority: HIGHEST for action port [ 787.379928] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.380086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.380160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.380391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.380479] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.381376] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.381490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.381700] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-15727094-ece5-4fb1-8322-671145325ae8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.381816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15727094-ece5-4fb1-8322-671145325ae8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.381880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15727094-ece5-4fb1-8322-671145325ae8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.382072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15727094-ece5-4fb1-8322-671145325ae8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.382148] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15727094-ece5-4fb1-8322-671145325ae8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.686216] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.686316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.686427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.686687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.687302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.687302] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 787.723020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.723247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.723329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.723581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.723734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.735482] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 787.884112] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.884315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.884590] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15727094-ece5-4fb1-8322-671145325ae8 with status ACTIVE [ 787.884824] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.884948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.885081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.885376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.885481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.885697] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.885811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.885876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.886422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.886422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.886576] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.886711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.886711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.886913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.887070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.888176] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15727094-ece5-4fb1-8322-671145325ae8 is going to be updated. [ 787.900788] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd in Status: SUCCESS [ 787.900963] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd deletion is rescheduled due to dependency. [ 787.901361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.916057] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.916265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.916265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.916591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.916766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.916924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15727094-ece5-4fb1-8322-671145325ae8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.068121] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: SUCCESS [ 788.068271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.068357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.068963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.068963] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.068963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.069174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.069408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.069408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.069408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.069644] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.573436] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.573891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.573891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.573891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.574931] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.574931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.574931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.574931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.574931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.574931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.574931] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.574931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.574931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.575551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.575551] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.575551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.575699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.575742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.575930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.575930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.576079] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.703554] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: SUCCESS [ 788.703806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.080961] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a251e98-2d26-4017-96a0-c67e8ea7efc0: rpc.has_security_group_logging(os_id): False [ 789.104443] env[66157]: INFO networking_nsxv3.common.synchronization [req-9d26545c-268a-45d0-bcdc-c87d3f0cdfb2 req-83b6d25e-b822-4efe-bffa-addfed529ee9 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_members [ 789.106493] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.106493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.106493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.106493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.106493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.106737] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.106845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.106914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.112523] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.112523] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.112523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.112523] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be created. [ 789.113885] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_members [ 789.116487] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.116643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.116785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.117110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.117273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.117402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.117484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.117699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.117832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.118103] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.183028] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 789.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.183028] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.183028] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.230662] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.233511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.235021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.235021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.235021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.254403] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: IN_PROGRESS for 2s [ 789.623037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.623423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.623423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.624623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.624742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.625100] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.625199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.625199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.625882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.625997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.626177] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b already deleted. [ 789.626262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.664072] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.664247] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.664247] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.664590] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.664874] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.665044] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.665186] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.665392] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.665562] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.665826] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.666019] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.666146] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.666257] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.666418] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.666624] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.666805] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.687369] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.689847] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.690012] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.690212] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.690450] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.690796] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-acd03dca-3c34-492c-a2f1-1361be3d8a21 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.691034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-acd03dca-3c34-492c-a2f1-1361be3d8a21" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.691203] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-acd03dca-3c34-492c-a2f1-1361be3d8a21" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.691584] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-acd03dca-3c34-492c-a2f1-1361be3d8a21" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.691905] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acd03dca-3c34-492c-a2f1-1361be3d8a21',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.748159] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 789.748418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.748613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.748974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.749229] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.749378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.749496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.749692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.749837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.749944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.750086] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.751926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.752171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.752591] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.752749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.752823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.753020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.753130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.753290] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.193827] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.195095] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.195273] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.195378] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.195668] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.195819] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.195964] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port acd03dca-3c34-492c-a2f1-1361be3d8a21 not found, creating... [ 790.196434] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.196434] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.196590] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.196698] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.196850] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.197892] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.198266] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.199803] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.200086] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.200232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.200379] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: acd03dca-3c34-492c-a2f1-1361be3d8a21 is going to be created. [ 790.221032] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.221032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.221032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.221261] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.221556] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.221787] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-acd03dca-3c34-492c-a2f1-1361be3d8a21" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.252145] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.253018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.257782] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.703817] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.703817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.703817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.704194] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.704194] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.704194] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 790.753139] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.753286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.753363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.753570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.754559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.761517] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.766032] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 790.972787] env[66157]: INFO networking_nsxv3.common.synchronization [req-9d26545c-268a-45d0-bcdc-c87d3f0cdfb2 req-224c0d92-c2c4-4357-813d-64c62820c201 service nova] Enqueued Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_rules [ 790.973565] env[66157]: INFO networking_nsxv3.common.synchronization [req-9d26545c-268a-45d0-bcdc-c87d3f0cdfb2 req-224c0d92-c2c4-4357-813d-64c62820c201 service nova] Enqueued Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_members [ 790.973565] env[66157]: INFO networking_nsxv3.common.synchronization [req-9d26545c-268a-45d0-bcdc-c87d3f0cdfb2 req-224c0d92-c2c4-4357-813d-64c62820c201 service nova] Enqueued Resource ID: acd03dca-3c34-492c-a2f1-1361be3d8a21 with Priority: HIGHEST for action port [ 790.973654] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_rules [ 790.973793] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_members [ 790.973903] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acd03dca-3c34-492c-a2f1-1361be3d8a21 with Priority: HIGHEST for action port [ 790.974764] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.975094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.975094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.975597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.975691] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.980254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.980254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.980254] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.980254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-acd03dca-3c34-492c-a2f1-1361be3d8a21 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acd03dca-3c34-492c-a2f1-1361be3d8a21" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acd03dca-3c34-492c-a2f1-1361be3d8a21" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.980254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acd03dca-3c34-492c-a2f1-1361be3d8a21" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.980254] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acd03dca-3c34-492c-a2f1-1361be3d8a21',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.250027] env[66157]: INFO networking_nsxv3.common.synchronization [req-32a91234-a047-48f2-8d01-5963b7239ca1 req-d9294c20-56c2-4985-a8d1-b4d555d2fd85 tempest-ServersWithSpecificFlavorTestJSON-563142723 tempest-ServersWithSpecificFlavorTestJSON-563142723-project-member] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 791.250473] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 791.251053] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.251418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.253054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.253054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.253054] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.253054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.253054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.253054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.253326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.253326] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.263769] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.263970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.264044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.264291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.264419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.264739] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 791.288056] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: SUCCESS [ 791.288056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.317047] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.317047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.317047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.317047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.317047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.330996] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 791.481277] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.483221] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.483221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.487318] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acd03dca-3c34-492c-a2f1-1361be3d8a21 with status ACTIVE [ 791.488308] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.488308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.488308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.488308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.488308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.488308] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.488614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.488614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.488778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.488859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.489176] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.489298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.489359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.489511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.489617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.489716] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acd03dca-3c34-492c-a2f1-1361be3d8a21 is going to be updated. [ 791.517569] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.518791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.518791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.518791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.518791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.518791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acd03dca-3c34-492c-a2f1-1361be3d8a21" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.756190] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.756570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.756736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.757026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.791602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.791671] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.791795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.791992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.792967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.792967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.792967] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be updated. [ 791.827758] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.828031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.828121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.828287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.828432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.839452] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: IN_PROGRESS for 2s [ 791.983408] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.485975] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.488038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.488038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.488038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.488038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.488038] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b is going to be created. [ 792.517349] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.517494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.517714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.517926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.518134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.532601] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b in Status: UNINITIALIZED for 2s [ 792.781658] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 792.781940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.782196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.782473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.782725] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.782882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.782971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.783222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.783338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.783450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.783575] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.200327] env[66157]: INFO networking_nsxv3.common.synchronization [req-f5b1b598-1726-4c14-a0f3-f9389a3fdeb0 req-9c340262-360b-4926-a268-c32516a96466 tempest-ImagesNegativeTestJSON-1702652676 tempest-ImagesNegativeTestJSON-1702652676-project-member] Enqueued Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGHEST for action security_group_members [ 793.200938] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGHEST for action security_group_members [ 793.201262] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a39b75b-de15-457f-a080-b14841d7ea90 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.201346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.201383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.201652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.201815] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.201894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.202647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.202647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.202647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.202647] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.287424] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.287768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.287905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.288286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.288568] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.288762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.288905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.289184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.289337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.289480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.289736] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.289895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.290013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.290225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.290416] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.290543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.290644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.290837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.290942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.291069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.291836] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.347397] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 793.347737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.347946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.348183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.348392] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.348577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.348657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.348851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.348971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.349086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.349267] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.349388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.349577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.350077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.350359] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.350359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.350469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.350591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.350677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.350787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.350846] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.704996] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.705206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.705206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.705593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.705593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.705883] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.706054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.706147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.706367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.706484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.706616] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a39b75b-de15-457f-a080-b14841d7ea90 already deleted. [ 793.706966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.797808] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 222383c0-b19b-4725-af40-286f27465c68: rpc.has_security_group_logging(os_id): False [ 793.819233] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.819427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.820288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.820288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.840459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.840720] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.840844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.840914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.841134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.841217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.841419] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.841519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.841586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.842121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.842121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.842121] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.842121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.842334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.842334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.842397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.842429] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 793.852957] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68270d8f-ab80-474f-8966-489611b2e965: rpc.has_security_group_logging(os_id): False [ 793.855307] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: SUCCESS [ 793.855470] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f deletion is rescheduled due to dependency. [ 793.855577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.865869] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-949 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.866069] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-949" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.866208] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-949" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.866501] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-949" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.867057] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.867057] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.867215] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.867320] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.867456] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.867823] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.867823] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.867947] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.867947] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.868064] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.868140] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.868266] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.886239] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.886430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.886469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.886687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.886790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.886973] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.887091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.887155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.887305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.887381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.887605] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.887712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.887775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.887918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.887992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.888187] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.888280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.888343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.888480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.888555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.888722] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 793.891105] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.891313] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.891484] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.891676] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-949" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.891995] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-e022c20f-f719-472e-9c90-8d7a6ba2275c taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.892197] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-e022c20f-f719-472e-9c90-8d7a6ba2275c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.892386] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-e022c20f-f719-472e-9c90-8d7a6ba2275c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.892799] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-e022c20f-f719-472e-9c90-8d7a6ba2275c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.892932] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e022c20f-f719-472e-9c90-8d7a6ba2275c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.921902] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.922153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.922153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.922439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.922592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.938563] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 793.973444] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.973632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.973632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.973858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.974016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.006263] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 794.399426] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.399426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.399426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.399426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.399426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.399426] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port e022c20f-f719-472e-9c90-8d7a6ba2275c not found, creating... [ 794.399886] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.399886] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.399965] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.400435] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.400435] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.400633] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.400820] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.400855] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.403253] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.403457] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.403623] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: e022c20f-f719-472e-9c90-8d7a6ba2275c is going to be created. [ 794.432792] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.432792] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.434108] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.434108] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.434495] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.434495] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-e022c20f-f719-472e-9c90-8d7a6ba2275c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.551251] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b in Status: SUCCESS [ 794.551440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.551753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.551878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.552127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.552223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.552293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.552584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.552584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.552680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.552713] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.055651] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.158098] env[66157]: INFO networking_nsxv3.common.synchronization [req-f5b1b598-1726-4c14-a0f3-f9389a3fdeb0 req-a2cf5d1e-f9f4-4358-9ca2-a17c73db72f7 service nova] Enqueued Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGHEST for action security_group_rules [ 795.158925] env[66157]: INFO networking_nsxv3.common.synchronization [req-f5b1b598-1726-4c14-a0f3-f9389a3fdeb0 req-a2cf5d1e-f9f4-4358-9ca2-a17c73db72f7 service nova] Enqueued Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGHEST for action security_group_members [ 795.159042] env[66157]: INFO networking_nsxv3.common.synchronization [req-f5b1b598-1726-4c14-a0f3-f9389a3fdeb0 req-a2cf5d1e-f9f4-4358-9ca2-a17c73db72f7 service nova] Enqueued Resource ID: e022c20f-f719-472e-9c90-8d7a6ba2275c with Priority: HIGHEST for action port [ 795.159580] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGHEST for action security_group_rules [ 795.159718] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGHEST for action security_group_members [ 795.159818] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e022c20f-f719-472e-9c90-8d7a6ba2275c with Priority: HIGHEST for action port [ 795.160093] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a39b75b-de15-457f-a080-b14841d7ea90 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.160216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.160276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.160533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.160614] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.161777] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a39b75b-de15-457f-a080-b14841d7ea90 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.161900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.161967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.162160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.162307] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.162400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.162463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.162600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.162687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.162777] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.163602] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e022c20f-f719-472e-9c90-8d7a6ba2275c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.163714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e022c20f-f719-472e-9c90-8d7a6ba2275c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.163786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e022c20f-f719-472e-9c90-8d7a6ba2275c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.163911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e022c20f-f719-472e-9c90-8d7a6ba2275c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.163984] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e022c20f-f719-472e-9c90-8d7a6ba2275c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.558840] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd4d34e1-d4d8-4980-86c7-3c5c3b76571b: rpc.has_security_group_logging(os_id): False [ 795.578051] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.578251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.578294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.578490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.578617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.578820] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.578917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.578979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.579168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.579216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.579302] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b is going to be created. [ 795.646269] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.646405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.646405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.646847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.646847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.659104] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b in Status: IN_PROGRESS for 2s [ 795.666464] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a39b75b-de15-457f-a080-b14841d7ea90 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.666593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.666872] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.667759] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e022c20f-f719-472e-9c90-8d7a6ba2275c with status ACTIVE [ 795.670683] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.670842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.670909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.671171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.671233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.671446] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.671663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.671663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.671774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.671852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.672049] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.672144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.672205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.672338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.672411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.672495] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e022c20f-f719-472e-9c90-8d7a6ba2275c is going to be updated. [ 795.729232] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.729232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.729232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.729232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.729232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.729232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e022c20f-f719-472e-9c90-8d7a6ba2275c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.954942] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 795.956466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.026090] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 796.026393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.027797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.028363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.028586] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.031251] env[66157]: INFO networking_nsxv3.common.synchronization [req-74f74d0a-5319-4cba-a37a-cf4a4728063a req-a3977340-a76f-45fd-8f1f-bccb9cf43568 tempest-VolumesAdminNegativeTest-840301258 tempest-VolumesAdminNegativeTest-840301258-project-member] Enqueued Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGHEST for action security_group_members [ 796.032385] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGHEST for action security_group_members [ 796.032944] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-65e20f28-433e-4752-bdc0-b5f939f691d0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.033247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.033374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.033695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.033945] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.034236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.034236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.034495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.034706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.034863] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.175016] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.374133] env[66157]: INFO networking_nsxv3.common.synchronization [None req-c07dd86a-6d79-4ce2-9633-461137aba177 None None] Enqueued Resource ID: 5f837d3a-e1a1-4b6d-a0da-fcd271707474 with Priority: HIGHEST for action port [ 796.374762] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f837d3a-e1a1-4b6d-a0da-fcd271707474 with Priority: HIGHEST for action port [ 796.375114] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f837d3a-e1a1-4b6d-a0da-fcd271707474 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.375259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f837d3a-e1a1-4b6d-a0da-fcd271707474" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.375331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f837d3a-e1a1-4b6d-a0da-fcd271707474" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.375617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f837d3a-e1a1-4b6d-a0da-fcd271707474" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.375776] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f837d3a-e1a1-4b6d-a0da-fcd271707474',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.533555] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.533727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.533879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.534016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.534272] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.534371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.534421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.534616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.534715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.535213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.535213] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.539557] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.539714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.539779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.540015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.540077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.540420] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.540420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.540420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.540736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.540736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.540736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 is going to be updated. [ 796.576259] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.576456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.576456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.577024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.577024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.589834] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 in Status: IN_PROGRESS for 2s [ 796.679502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.679661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.679734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.679955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.680060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.680496] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a39b75b-de15-457f-a080-b14841d7ea90 is going to be created. [ 796.705757] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.705915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.706057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.706332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.707063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.725437] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a39b75b-de15-457f-a080-b14841d7ea90 in Status: UNINITIALIZED for 2s [ 796.878209] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f837d3a-e1a1-4b6d-a0da-fcd271707474 [ 796.878314] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.878428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.878503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.878727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.878822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.878920] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f837d3a-e1a1-4b6d-a0da-fcd271707474 already deleted. [ 796.880035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f837d3a-e1a1-4b6d-a0da-fcd271707474" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.041502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.041502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.041502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.041502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.041502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.048615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.048615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.048615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.048615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.048615] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.546946] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68270d8f-ab80-474f-8966-489611b2e965: rpc.has_security_group_logging(os_id): False [ 797.568014] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.568214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.568290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.568980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.568980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.568980] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.568980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.568980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.570800] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.570800] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.570800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.570800] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 797.641312] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.641312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.641312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.641698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.641882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.660070] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 797.672041] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b in Status: SUCCESS [ 797.672041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.424790] env[66157]: INFO networking_nsxv3.common.synchronization [req-39133875-4dfe-4656-ba1e-afff4288d0ba req-c13c92a5-59a7-422a-96f2-1d28c3183fde tempest-ServerRescueNegativeTestJSON-2006998581 tempest-ServerRescueNegativeTestJSON-2006998581-project-member] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 798.425361] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 798.425663] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.425782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.425851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.427399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.428025] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.428025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.428175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.428254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.428347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.428445] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.601405] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 in Status: SUCCESS [ 798.601405] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 deletion is rescheduled due to dependency. [ 798.601405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.739233] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a39b75b-de15-457f-a080-b14841d7ea90 in Status: SUCCESS [ 798.739547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.739737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.739954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.740219] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.740348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.740348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.740468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.740546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.740629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.740757] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.823021] env[66157]: INFO networking_nsxv3.common.synchronization [None req-e3dcb64a-da1b-40df-bafa-cd831c95cedc None None] Enqueued Resource ID: 9b23a2d2-3896-4eb7-b435-fd451ad03f44 with Priority: HIGHEST for action port [ 798.823684] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b23a2d2-3896-4eb7-b435-fd451ad03f44 with Priority: HIGHEST for action port [ 798.824229] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b23a2d2-3896-4eb7-b435-fd451ad03f44 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.824918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b23a2d2-3896-4eb7-b435-fd451ad03f44" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.825266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b23a2d2-3896-4eb7-b435-fd451ad03f44" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.825639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b23a2d2-3896-4eb7-b435-fd451ad03f44" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.825773] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b23a2d2-3896-4eb7-b435-fd451ad03f44',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.932241] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.101684] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.101684] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.101684] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.101684] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.101684] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.101684] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.101684] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.102052] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.102299] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.105188] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.105338] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.105454] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.105570] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.106461] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.106461] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.106461] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.125203] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.125369] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.125512] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.125684] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.126015] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.126217] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.126364] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.126678] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.126876] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dab349e-c14a-4b6b-b5e9-edffe1dc48a2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.243418] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a39b75b-de15-457f-a080-b14841d7ea90 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.243570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.243632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.244795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.244795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.244795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.244795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.244795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.244795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.244795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.244795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a39b75b-de15-457f-a080-b14841d7ea90 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.244795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.244795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.245248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.245248] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.245248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.245248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.245384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.245444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.245555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.245662] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.328995] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b23a2d2-3896-4eb7-b435-fd451ad03f44 [ 799.329276] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.329415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.329497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.329699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.329789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.329907] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b23a2d2-3896-4eb7-b435-fd451ad03f44 already deleted. [ 799.329979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b23a2d2-3896-4eb7-b435-fd451ad03f44" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.434649] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.546211] env[66157]: INFO networking_nsxv3.common.synchronization [None req-724370bd-0e88-484c-a3e7-334dcc7c3e46 None None] Enqueued Resource ID: 919e924c-d996-4c82-be9c-a02a3c9e4027 with Priority: HIGHEST for action port [ 799.548443] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 919e924c-d996-4c82-be9c-a02a3c9e4027 with Priority: HIGHEST for action port [ 799.548443] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-919e924c-d996-4c82-be9c-a02a3c9e4027 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.548443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-919e924c-d996-4c82-be9c-a02a3c9e4027" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.548443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-919e924c-d996-4c82-be9c-a02a3c9e4027" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.548443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-919e924c-d996-4c82-be9c-a02a3c9e4027" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.548443] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919e924c-d996-4c82-be9c-a02a3c9e4027',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.635206] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.635206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.635206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.635206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.635206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.635206] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 9dab349e-c14a-4b6b-b5e9-edffe1dc48a2 not found, creating... [ 799.635206] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.635206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.635206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.635206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.635206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.635769] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.635769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.635769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.635769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.635769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.635769] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 9dab349e-c14a-4b6b-b5e9-edffe1dc48a2 is going to be created. [ 799.662490] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.662742] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.662861] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.664036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.664036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.664036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.682135] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 799.682360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.750950] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a39b75b-de15-457f-a080-b14841d7ea90: rpc.has_security_group_logging(os_id): False [ 799.768141] env[66157]: INFO networking_nsxv3.common.synchronization [None req-71eaafdd-f4a7-45f1-be51-a1869c3a99eb None None] Enqueued Resource ID: d3aa11bc-40c0-4ba3-b647-ceeedc056de6 with Priority: HIGHEST for action port [ 799.769463] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.770252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.770404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.770680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.770892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.771175] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.771388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.771536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.771780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.772221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.772527] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.772738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.772886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.773133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.773346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.773640] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.773844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.774018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.774998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.774998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.774998] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a39b75b-de15-457f-a080-b14841d7ea90 is going to be created. [ 799.776583] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3aa11bc-40c0-4ba3-b647-ceeedc056de6 with Priority: HIGHEST for action port [ 799.777022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3aa11bc-40c0-4ba3-b647-ceeedc056de6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.777258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3aa11bc-40c0-4ba3-b647-ceeedc056de6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.777594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3aa11bc-40c0-4ba3-b647-ceeedc056de6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.777972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3aa11bc-40c0-4ba3-b647-ceeedc056de6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.778855] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3aa11bc-40c0-4ba3-b647-ceeedc056de6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.872301] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.872301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.872301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.872301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.872301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.884932] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a39b75b-de15-457f-a080-b14841d7ea90 in Status: IN_PROGRESS for 2s [ 799.939773] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.939773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.939773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.939773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.939773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.939773] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be updated. [ 799.977091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.977328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.977386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.977556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.977701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.989913] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: IN_PROGRESS for 2s [ 800.052082] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 919e924c-d996-4c82-be9c-a02a3c9e4027 [ 800.052082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.052082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.052082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.052082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.052082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.052082] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:919e924c-d996-4c82-be9c-a02a3c9e4027 already deleted. [ 800.052082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-919e924c-d996-4c82-be9c-a02a3c9e4027" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.286286] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3aa11bc-40c0-4ba3-b647-ceeedc056de6 [ 800.286286] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.286286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.286286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.286286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.286286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.286286] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3aa11bc-40c0-4ba3-b647-ceeedc056de6 already deleted. [ 800.286286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3aa11bc-40c0-4ba3-b647-ceeedc056de6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.455626] env[66157]: INFO networking_nsxv3.common.synchronization [req-39133875-4dfe-4656-ba1e-afff4288d0ba req-91bb35fb-b149-4b8a-8b9e-26c03247d73b service nova] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_rules [ 800.455903] env[66157]: INFO networking_nsxv3.common.synchronization [req-39133875-4dfe-4656-ba1e-afff4288d0ba req-91bb35fb-b149-4b8a-8b9e-26c03247d73b service nova] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 800.455974] env[66157]: INFO networking_nsxv3.common.synchronization [req-39133875-4dfe-4656-ba1e-afff4288d0ba req-91bb35fb-b149-4b8a-8b9e-26c03247d73b service nova] Enqueued Resource ID: 9dab349e-c14a-4b6b-b5e9-edffe1dc48a2 with Priority: HIGHEST for action port [ 800.456541] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_rules [ 800.456686] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 800.456820] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dab349e-c14a-4b6b-b5e9-edffe1dc48a2 with Priority: HIGHEST for action port [ 800.457682] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.457821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.457915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.458168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.458267] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.459923] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.460049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.460260] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.460359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.460418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.460730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.460787] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dab349e-c14a-4b6b-b5e9-edffe1dc48a2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.883993] env[66157]: INFO networking_nsxv3.common.synchronization [req-08425324-43da-4a68-8711-6996c7078bc5 req-bb1f3252-ab56-45d5-b224-fa0b9452b7c5 tempest-FloatingIPsAssociationNegativeTestJSON-1153726644 tempest-FloatingIPsAssociationNegativeTestJSON-1153726644-project-member] Enqueued Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGHEST for action security_group_members [ 800.883993] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGHEST for action security_group_members [ 800.883993] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-74a77e67-2ad3-434b-99a3-df9c4d1391b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.883993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.883993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.885943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.885943] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.885943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.885943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.886190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.886190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.886256] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.961894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.962132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.966687] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dab349e-c14a-4b6b-b5e9-edffe1dc48a2 with status ACTIVE [ 800.966687] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.966687] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.966687] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.966687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.966687] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dab349e-c14a-4b6b-b5e9-edffe1dc48a2 is going to be updated. [ 800.992213] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.992368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.992455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.992639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.992759] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.992929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dab349e-c14a-4b6b-b5e9-edffe1dc48a2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.390044] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.390361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.390361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.390515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.390605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.390870] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.390948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.391055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.391606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.391707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.391798] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 already deleted. [ 801.391884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.468855] env[66157]: INFO networking_nsxv3.common.synchronization [None req-14ca3c9d-a416-4d0d-8606-27b914ca0091 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_rules [ 801.469640] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_rules [ 801.469795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.470764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.470764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.470764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.470764] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.618090] env[66157]: INFO networking_nsxv3.common.synchronization [None req-de1de0a9-ffea-4dd7-9678-d1c09d52146c tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_rules [ 801.618090] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_rules [ 801.618090] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.619919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.899958] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a39b75b-de15-457f-a080-b14841d7ea90 in Status: SUCCESS [ 801.900306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.992717] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.992892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.992938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.993159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.993292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.993336] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 already deleted. [ 801.993416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.993580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.993753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.993864] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.004343] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: SUCCESS [ 802.004544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.004750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.005212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.005212] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.005307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.005389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.005477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.005559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.005850] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.090400] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.090596] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-828" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.090713] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-828" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.091046] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-828" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.091309] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.091460] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.091575] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.091800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.093369] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.093629] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.093745] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.093851] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.093957] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.094077] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.094181] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.094309] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.113353] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.113353] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.113353] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.113483] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-828" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.113702] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.113868] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.113982] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.114318] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.114466] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddcaf627-8bf9-43be-8cec-f1a7114cc4a6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.118577] env[66157]: INFO networking_nsxv3.common.synchronization [None req-5060a93d-a4ea-445e-bd13-ce41e0fce704 None None] Enqueued Resource ID: 5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3 with Priority: HIGHEST for action port [ 802.119464] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3 with Priority: HIGHEST for action port [ 802.119793] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.119926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.120658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.121348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.121348] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.510090] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.523395] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.524399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.524484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.524711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.524880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.525030] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 already deleted. [ 802.525094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.605708] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f42611ad-0b35-44e2-80e7-a614facf1cfc None None] Enqueued Resource ID: 0d165f64-d78e-43eb-bc60-e52afa5aac71 with Priority: HIGHEST for action port [ 802.606187] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d165f64-d78e-43eb-bc60-e52afa5aac71 with Priority: HIGHEST for action port [ 802.606622] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d165f64-d78e-43eb-bc60-e52afa5aac71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.606622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d165f64-d78e-43eb-bc60-e52afa5aac71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.606622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d165f64-d78e-43eb-bc60-e52afa5aac71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.606970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d165f64-d78e-43eb-bc60-e52afa5aac71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.607328] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d165f64-d78e-43eb-bc60-e52afa5aac71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.618927] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.619286] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.619387] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.619582] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.619728] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.619874] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port ddcaf627-8bf9-43be-8cec-f1a7114cc4a6 not found, creating... [ 802.620157] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.620300] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.620419] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.620682] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.620802] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.621085] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.621235] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.621983] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.621983] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.621983] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.622164] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: ddcaf627-8bf9-43be-8cec-f1a7114cc4a6 is going to be created. [ 802.624006] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3 [ 802.624187] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.624294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.624358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.624511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.624589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.624673] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3 already deleted. [ 802.624750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5523bf9f-cf10-4f1a-88be-a47f5ce5a3b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.645571] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.645780] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.645846] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.647052] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.647052] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.647052] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.012134] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.110560] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d165f64-d78e-43eb-bc60-e52afa5aac71 [ 803.110733] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.110844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.110898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.111135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.111232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.111327] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d165f64-d78e-43eb-bc60-e52afa5aac71 already deleted. [ 803.111582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d165f64-d78e-43eb-bc60-e52afa5aac71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.340732] env[66157]: INFO networking_nsxv3.common.synchronization [req-08425324-43da-4a68-8711-6996c7078bc5 req-d0823a06-b2c1-4703-abde-0f9d9dc46fe7 service nova] Enqueued Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGHEST for action security_group_rules [ 803.340873] env[66157]: INFO networking_nsxv3.common.synchronization [req-08425324-43da-4a68-8711-6996c7078bc5 req-d0823a06-b2c1-4703-abde-0f9d9dc46fe7 service nova] Enqueued Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGHEST for action security_group_members [ 803.341057] env[66157]: INFO networking_nsxv3.common.synchronization [req-08425324-43da-4a68-8711-6996c7078bc5 req-d0823a06-b2c1-4703-abde-0f9d9dc46fe7 service nova] Enqueued Resource ID: ddcaf627-8bf9-43be-8cec-f1a7114cc4a6 with Priority: HIGHEST for action port [ 803.341580] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGHEST for action security_group_rules [ 803.341656] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGHEST for action security_group_members [ 803.341756] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddcaf627-8bf9-43be-8cec-f1a7114cc4a6 with Priority: HIGHEST for action port [ 803.342045] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.342169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.342226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.342476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.342557] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.343387] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-74a77e67-2ad3-434b-99a3-df9c4d1391b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.343510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.343579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.343741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.344746] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.346255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.346358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.346525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.346616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.346714] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.347555] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.347660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.347725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.347875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.347961] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddcaf627-8bf9-43be-8cec-f1a7114cc4a6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.516643] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.516810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.516873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.517212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.517342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.517383] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be updated. [ 803.548899] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.549078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.549122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.549335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.549492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.560447] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: IN_PROGRESS for 2s [ 803.854088] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.854088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-74a77e67-2ad3-434b-99a3-df9c4d1391b9 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.854088] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddcaf627-8bf9-43be-8cec-f1a7114cc4a6 with status ACTIVE [ 803.854088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.854088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.854088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.854783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.854783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.854783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.854783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.854783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.854783] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddcaf627-8bf9-43be-8cec-f1a7114cc4a6 is going to be updated. [ 803.882151] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.882385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.882385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.882599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.882735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.882951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddcaf627-8bf9-43be-8cec-f1a7114cc4a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.330823] env[66157]: INFO networking_nsxv3.common.synchronization [None req-8411b0a2-ca10-4b4f-81d1-731d4e39b558 None None] Enqueued Resource ID: bb6a5061-4933-49ba-b462-02734dffc6cd with Priority: HIGHEST for action port [ 804.331575] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb6a5061-4933-49ba-b462-02734dffc6cd with Priority: HIGHEST for action port [ 804.331925] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb6a5061-4933-49ba-b462-02734dffc6cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.332080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb6a5061-4933-49ba-b462-02734dffc6cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.332150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb6a5061-4933-49ba-b462-02734dffc6cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.332473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb6a5061-4933-49ba-b462-02734dffc6cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.332567] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb6a5061-4933-49ba-b462-02734dffc6cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.357824] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.836648] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb6a5061-4933-49ba-b462-02734dffc6cd [ 804.836648] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.836648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.836648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.836648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.836648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.836648] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb6a5061-4933-49ba-b462-02734dffc6cd already deleted. [ 804.836648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb6a5061-4933-49ba-b462-02734dffc6cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.863154] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.863154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.863154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.863154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.863154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.863338] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 is going to be created. [ 804.891219] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.891429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.891429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.891965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.891965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.907968] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 in Status: UNINITIALIZED for 2s [ 805.552813] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:0 completed [ 805.553090] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:1 started [ 805.575253] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: SUCCESS [ 805.575768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.575768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.576193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.576238] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.576878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.576878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.576878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.576878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.576878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.576878] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.083114] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.083114] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.083114] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.083114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.083572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.083572] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.083572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.083666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.084150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.084150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.084150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.084308] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.586091] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a251e98-2d26-4017-96a0-c67e8ea7efc0: rpc.has_security_group_logging(os_id): False [ 806.608506] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.608832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.609999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.609999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.609999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.609999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.609999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.609999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.609999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.609999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.610412] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.610412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.610412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.610412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.610580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.610669] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.610845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.610845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.611106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.611106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.611198] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be updated. [ 806.678565] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.678565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.678565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.678565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.679382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.693644] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: IN_PROGRESS for 2s [ 806.914785] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 in Status: SUCCESS [ 806.914995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.915206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.915552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.915654] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.915739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.915739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.916023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.916023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.916085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.916147] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.419217] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-74a77e67-2ad3-434b-99a3-df9c4d1391b9 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.419743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.420103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.420426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.421435] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.421631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.421860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.422270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.422431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.422674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.423023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-74a77e67-2ad3-434b-99a3-df9c4d1391b9 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.423165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.423280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.424203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.424432] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.424699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.425230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.425481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.425529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.425597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.425728] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.666386] env[66157]: INFO networking_nsxv3.common.synchronization [None req-319563e7-a143-4676-b68b-dcc18b528307 None None] Enqueued Resource ID: 292ee49e-9048-4263-a4df-ebb94c3f390b with Priority: HIGHEST for action port [ 807.666865] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 292ee49e-9048-4263-a4df-ebb94c3f390b with Priority: HIGHEST for action port [ 807.667441] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-292ee49e-9048-4263-a4df-ebb94c3f390b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.667590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-292ee49e-9048-4263-a4df-ebb94c3f390b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.667661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-292ee49e-9048-4263-a4df-ebb94c3f390b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.667916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-292ee49e-9048-4263-a4df-ebb94c3f390b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.668046] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('292ee49e-9048-4263-a4df-ebb94c3f390b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.934030] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74a77e67-2ad3-434b-99a3-df9c4d1391b9: rpc.has_security_group_logging(os_id): False [ 807.955780] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.955883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.955957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.956216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.956279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.956463] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.956562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.956701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.956768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.957474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.957474] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.957474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.957474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.957734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.957784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.958175] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.958316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.958407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.958614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.958723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.958841] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 is going to be created. [ 808.017890] env[66157]: INFO networking_nsxv3.common.synchronization [req-d64b9ed0-5fd2-4f0f-bebc-fdce1f5cd0ea req-6c4b12fd-11d6-43e5-b9bd-4f27070d13d6 tempest-ServersAdminNegativeTestJSON-2016589142 tempest-ServersAdminNegativeTestJSON-2016589142-project-member] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 808.019439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.019581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.019670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.020103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.020371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.022589] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 808.022675] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.022836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.022932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.023147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.023370] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.023483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.023534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.023698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.023813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.023935] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.035760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 in Status: IN_PROGRESS for 2s [ 808.172338] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 292ee49e-9048-4263-a4df-ebb94c3f390b [ 808.172602] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.172747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.173022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.173126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.173254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.173365] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:292ee49e-9048-4263-a4df-ebb94c3f390b already deleted. [ 808.173449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-292ee49e-9048-4263-a4df-ebb94c3f390b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.217795] env[66157]: INFO networking_nsxv3.common.synchronization [req-21806af3-67c7-4d41-b694-47ae512f2873 req-e21e9bd1-bb94-46b3-b3fc-731aad5c82c0 tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 808.218215] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 808.218771] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.219019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.219229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.219585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.220580] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.220580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.220580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.220580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.220580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.220947] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.464490] env[66157]: INFO networking_nsxv3.common.synchronization [None req-558f8a10-0052-45e5-a797-3453f8cffaec tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_rules [ 808.465222] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_rules [ 808.465896] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.466474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.466474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.466768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.466831] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.527539] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.649902] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.650213] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.650382] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.650693] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.650985] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.651159] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.651276] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.651526] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.651717] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.651875] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.652148] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.652218] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.652309] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.652439] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.652570] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.652706] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.676677] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.676677] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.676677] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.676677] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.677880] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-88769f31-6354-45f0-a06d-f41532e868e0 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.677880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-88769f31-6354-45f0-a06d-f41532e868e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.677880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-88769f31-6354-45f0-a06d-f41532e868e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.677880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-88769f31-6354-45f0-a06d-f41532e868e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.677880] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88769f31-6354-45f0-a06d-f41532e868e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.709864] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: SUCCESS [ 808.710189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.726295] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.788691] env[66157]: INFO networking_nsxv3.common.synchronization [req-21806af3-67c7-4d41-b694-47ae512f2873 req-45aa38f5-9f8b-4e38-99e5-a031efb9195a tempest-ServersTestMultiNic-1759147421 tempest-ServersTestMultiNic-1759147421-project-member] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 808.789118] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGHEST for action security_group_members [ 808.789479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.789617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.956626] env[66157]: INFO networking_nsxv3.common.synchronization [None req-64ac733b-7bc7-4827-8642-bbed80ca11a2 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_rules [ 808.958094] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_rules [ 808.958094] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.958094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.989338] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.989630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.989630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.989851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.989935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.990044] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 already deleted. [ 808.990132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.990660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.990829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.990919] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.031751] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.180746] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.181061] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.181226] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.181498] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.181645] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.181823] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 88769f31-6354-45f0-a06d-f41532e868e0 not found, creating... [ 809.182201] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.182386] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.182510] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.182733] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.182866] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.183190] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.183448] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.183576] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.183811] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.183959] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.184130] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 88769f31-6354-45f0-a06d-f41532e868e0 is going to be created. [ 809.207541] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.207729] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.207843] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.208150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.208475] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.208701] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-88769f31-6354-45f0-a06d-f41532e868e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.230933] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.516457] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.516610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.516727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.516943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.517039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.517187] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 already deleted. [ 809.517288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.535419] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.535627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.535680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.536117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.536117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.536117] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be updated. [ 809.571331] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.571488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.571488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.571762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.571908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.581840] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: IN_PROGRESS for 2s [ 809.735146] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.735568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.735568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.735568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.735749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.735749] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 809.767779] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.767899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.768566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.768566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.768566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.778260] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 809.991443] env[66157]: INFO networking_nsxv3.common.synchronization [req-d64b9ed0-5fd2-4f0f-bebc-fdce1f5cd0ea req-39c522b4-635c-4bf8-89f0-6698e688095c service nova] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_rules [ 809.991634] env[66157]: INFO networking_nsxv3.common.synchronization [req-d64b9ed0-5fd2-4f0f-bebc-fdce1f5cd0ea req-39c522b4-635c-4bf8-89f0-6698e688095c service nova] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 809.991748] env[66157]: INFO networking_nsxv3.common.synchronization [req-d64b9ed0-5fd2-4f0f-bebc-fdce1f5cd0ea req-39c522b4-635c-4bf8-89f0-6698e688095c service nova] Enqueued Resource ID: 88769f31-6354-45f0-a06d-f41532e868e0 with Priority: HIGHEST for action port [ 809.992326] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_rules [ 809.992411] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 809.992791] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88769f31-6354-45f0-a06d-f41532e868e0 with Priority: HIGHEST for action port [ 809.992791] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.992909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.992943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.993165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.993249] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.994260] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.994330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.995080] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-88769f31-6354-45f0-a06d-f41532e868e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.995080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88769f31-6354-45f0-a06d-f41532e868e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.995080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88769f31-6354-45f0-a06d-f41532e868e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.995080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88769f31-6354-45f0-a06d-f41532e868e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.995080] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88769f31-6354-45f0-a06d-f41532e868e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.049281] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 in Status: SUCCESS [ 810.049512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.496949] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.497062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.497415] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88769f31-6354-45f0-a06d-f41532e868e0 with status ACTIVE [ 810.497734] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.497920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.498051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.498386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.498559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.498854] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.499029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.499157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.499437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.499576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.499893] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.500092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.500250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.500452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.500586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.500736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88769f31-6354-45f0-a06d-f41532e868e0 is going to be updated. [ 810.528618] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.528781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.528857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.529126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.529281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.529451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88769f31-6354-45f0-a06d-f41532e868e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.593631] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: SUCCESS [ 811.593911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.593911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.594549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.596044] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.596044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.596044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.596044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.596044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.596320] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.790724] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 811.793125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.793125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.793125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.793362] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.793362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.793362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.793471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.794048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.794048] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.099668] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.296803] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.296973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.297033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.297288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.297382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.297585] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.297694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.297735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.297919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.297919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.298812] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be updated. [ 812.335939] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.336191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.336191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.336482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.336563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.346908] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: IN_PROGRESS for 2s [ 812.450961] env[66157]: INFO networking_nsxv3.common.synchronization [req-6bd5be22-fabe-4e69-a0d7-7ec2694ed744 req-824d21ab-d84b-4d78-bda8-f52c8ff0d2f2 tempest-ImagesNegativeTestJSON-1702652676 tempest-ImagesNegativeTestJSON-1702652676-project-member] Enqueued Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGHEST for action security_group_members [ 812.451677] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGHEST for action security_group_members [ 812.452193] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a39b75b-de15-457f-a080-b14841d7ea90 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.452344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.452436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.452660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.452899] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.452991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.453119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.453295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.453411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.453526] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.605328] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.959301] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.959301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.959301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.959301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.959301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.959301] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.959301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.959301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.959301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.959301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.959301] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a39b75b-de15-457f-a080-b14841d7ea90 is going to be updated. [ 812.995038] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.995038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.995038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.995038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.995038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.002918] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a39b75b-de15-457f-a080-b14841d7ea90 in Status: IN_PROGRESS for 2s [ 813.110975] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.110975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.110975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.110975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.110975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.110975] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be updated. [ 813.141628] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.141628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.141628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.141628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.141628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.152293] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: IN_PROGRESS for 2s [ 814.360189] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68270d8f-ab80-474f-8966-489611b2e965 in Status: SUCCESS [ 814.360514] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68270d8f-ab80-474f-8966-489611b2e965 deletion is rescheduled due to dependency. [ 814.360514] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.014221] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a39b75b-de15-457f-a080-b14841d7ea90 in Status: SUCCESS [ 815.014398] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a39b75b-de15-457f-a080-b14841d7ea90 deletion is rescheduled due to dependency. [ 815.014541] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.164107] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: SUCCESS [ 815.164344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.164517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.164744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.164938] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.165078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.165140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.167978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.167978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.167978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.167978] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.671997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.671997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.671997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.671997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.671997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.672913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.672913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.672913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.672913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.672913] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.176120] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83c10e8c-149e-450b-b827-98a5e9d401e0: rpc.has_security_group_logging(os_id): False [ 816.195423] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.195544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.195608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.195827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.219677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.219949] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.220094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.220163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.220551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.220643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.220847] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.220948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.221033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.221168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.221285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.221478] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.221605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.221664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.221868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.221868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.222019] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be updated. [ 816.314085] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.314085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.314085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.314085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.314085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.328943] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: IN_PROGRESS for 2s [ 817.452858] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 817.453336] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 818.346844] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: SUCCESS [ 818.347130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.535958] env[66157]: INFO networking_nsxv3.common.synchronization [req-f81c5628-8e41-4035-8b63-80f5016da67f req-ff4fea85-4617-404c-930d-b20f35ca6420 tempest-ServerRescueTestJSON-1845946177 tempest-ServerRescueTestJSON-1845946177-project-member] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 818.536690] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGHEST for action security_group_members [ 818.538469] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.538469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.538469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.538469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.538727] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.538727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.538816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.538958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.539061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.539170] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.044416] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.044416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.044416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.044660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.069414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.069693] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.069846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.069903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.070122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.070222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.070335] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 is going to be updated. [ 819.099449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.099596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.099667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.099962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.100125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.109735] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: IN_PROGRESS for 2s [ 819.265337] env[66157]: INFO networking_nsxv3.common.synchronization [req-016580a7-d09a-46b1-8cfa-d194fdb89c9f req-dd1c7a68-fa7f-462c-8809-ab4ab343f038 tempest-MigrationsAdminTest-406320684 tempest-MigrationsAdminTest-406320684-project-member] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 819.265667] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 819.265842] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.265968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.266047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.266825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.266825] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.266965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.266965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.267077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.267165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.267264] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.663141] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.663141] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.663141] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.663515] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.663547] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.664331] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.664331] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.664331] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.664331] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.664510] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.664510] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.664582] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.664662] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.664759] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.664864] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.664985] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.687201] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.687361] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.687445] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.687691] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-302" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.689096] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-566657a1-3ff1-46ff-bf71-bfc2d09633e4 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.689096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-566657a1-3ff1-46ff-bf71-bfc2d09633e4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.689096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-566657a1-3ff1-46ff-bf71-bfc2d09633e4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.689096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-566657a1-3ff1-46ff-bf71-bfc2d09633e4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.689096] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('566657a1-3ff1-46ff-bf71-bfc2d09633e4',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.769349] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.191446] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.191706] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.191842] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.192152] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.192328] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.192510] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 566657a1-3ff1-46ff-bf71-bfc2d09633e4 not found, creating... [ 820.192811] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.192989] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.193136] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.193372] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.193534] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.193882] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.194082] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.194210] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.194446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.194585] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.194723] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 566657a1-3ff1-46ff-bf71-bfc2d09633e4 is going to be created. [ 820.223247] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.223503] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.223636] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.223923] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.224219] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.224631] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-566657a1-3ff1-46ff-bf71-bfc2d09633e4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.271659] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.773769] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.774293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.774293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.774293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.774495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.774495] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 is going to be updated. [ 820.829882] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.830027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.830066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.831227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.831415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.842858] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: IN_PROGRESS for 2s [ 820.938995] env[66157]: INFO networking_nsxv3.common.synchronization [req-016580a7-d09a-46b1-8cfa-d194fdb89c9f req-7fe7e09d-eff6-4c2e-8bec-16411b507048 service nova] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_rules [ 820.939397] env[66157]: INFO networking_nsxv3.common.synchronization [req-016580a7-d09a-46b1-8cfa-d194fdb89c9f req-7fe7e09d-eff6-4c2e-8bec-16411b507048 service nova] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 820.939397] env[66157]: INFO networking_nsxv3.common.synchronization [req-016580a7-d09a-46b1-8cfa-d194fdb89c9f req-7fe7e09d-eff6-4c2e-8bec-16411b507048 service nova] Enqueued Resource ID: 566657a1-3ff1-46ff-bf71-bfc2d09633e4 with Priority: HIGHEST for action port [ 820.939924] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_rules [ 820.940084] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 820.940188] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 566657a1-3ff1-46ff-bf71-bfc2d09633e4 with Priority: HIGHEST for action port [ 820.940526] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.940637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.940679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.940879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.940958] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.941873] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.941990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.943273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-566657a1-3ff1-46ff-bf71-bfc2d09633e4 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.943273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-566657a1-3ff1-46ff-bf71-bfc2d09633e4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.943273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-566657a1-3ff1-46ff-bf71-bfc2d09633e4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.943273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-566657a1-3ff1-46ff-bf71-bfc2d09633e4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.943273] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('566657a1-3ff1-46ff-bf71-bfc2d09633e4',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.121802] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 in Status: SUCCESS [ 821.121802] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 deletion is rescheduled due to dependency. [ 821.121802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.445302] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.445450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.446826] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 566657a1-3ff1-46ff-bf71-bfc2d09633e4 with status ACTIVE [ 821.447041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.447210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.447253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.447452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.447540] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.447794] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.447897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.447958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.448155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.448208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.448394] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.448486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.448546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.448723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.448934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.448986] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 566657a1-3ff1-46ff-bf71-bfc2d09633e4 is going to be updated. [ 821.477619] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.477619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.477619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.477619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.477619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.477619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-566657a1-3ff1-46ff-bf71-bfc2d09633e4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.670775] env[66157]: INFO networking_nsxv3.common.synchronization [None req-5271ea8e-343c-4176-bef0-12dcebd6eb55 None None] Enqueued Resource ID: 0d46a912-9b92-499b-9305-1b0eb39f7d12 with Priority: HIGHEST for action port [ 821.670775] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d46a912-9b92-499b-9305-1b0eb39f7d12 with Priority: HIGHEST for action port [ 821.671806] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d46a912-9b92-499b-9305-1b0eb39f7d12 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.674046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d46a912-9b92-499b-9305-1b0eb39f7d12" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.674046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d46a912-9b92-499b-9305-1b0eb39f7d12" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.674046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d46a912-9b92-499b-9305-1b0eb39f7d12" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.674046] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d46a912-9b92-499b-9305-1b0eb39f7d12',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.031873] env[66157]: INFO networking_nsxv3.common.synchronization [req-5a2e0db9-3ee2-48c1-8c9b-cbf9a92d8f6e req-6f5a1b19-9996-407c-b4c3-2dd37a146c83 tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 822.033416] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 822.034873] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.035015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.035090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.035522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.035522] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.035631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.035631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.035799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.035886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.035985] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.182750] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d46a912-9b92-499b-9305-1b0eb39f7d12 [ 822.182750] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.182750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.182750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.182750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.182750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.182750] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d46a912-9b92-499b-9305-1b0eb39f7d12 already deleted. [ 822.182750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d46a912-9b92-499b-9305-1b0eb39f7d12" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.487612] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.487933] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.488105] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.488408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.488740] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.488955] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.491557] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.491557] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.491557] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.491557] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.491557] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.491557] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.491557] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.491842] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.491842] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.492061] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.513905] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.514097] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.514235] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.514403] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.514746] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-45f9e90c-9b95-445a-8c55-a9827dceaca0 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.515089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-45f9e90c-9b95-445a-8c55-a9827dceaca0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.515089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-45f9e90c-9b95-445a-8c55-a9827dceaca0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.515400] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-45f9e90c-9b95-445a-8c55-a9827dceaca0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.515565] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f9e90c-9b95-445a-8c55-a9827dceaca0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.539610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.542436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.542436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.542436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.572745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.573018] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.573147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.573217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.573430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.573510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.573599] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 822.621451] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.621603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.621705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.622057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.622057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.633653] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 822.853267] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: SUCCESS [ 822.853267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.853267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.853583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.853681] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.853800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.853872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.854057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.854146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.854224] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.019171] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.019413] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.019529] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.019799] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.019939] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.020129] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 45f9e90c-9b95-445a-8c55-a9827dceaca0 not found, creating... [ 823.020399] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.020562] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.020673] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.020884] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.022142] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.022142] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.022142] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.022142] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.022474] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.022506] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.022621] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 45f9e90c-9b95-445a-8c55-a9827dceaca0 is going to be created. [ 823.048036] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.048381] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.048447] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.048765] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.049374] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.049474] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-45f9e90c-9b95-445a-8c55-a9827dceaca0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.357376] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.810198] env[66157]: INFO networking_nsxv3.common.synchronization [req-5a2e0db9-3ee2-48c1-8c9b-cbf9a92d8f6e req-1eeccd1f-8fa9-48e7-a444-ae9e829b54a0 service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 823.810503] env[66157]: INFO networking_nsxv3.common.synchronization [req-5a2e0db9-3ee2-48c1-8c9b-cbf9a92d8f6e req-1eeccd1f-8fa9-48e7-a444-ae9e829b54a0 service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 823.810706] env[66157]: INFO networking_nsxv3.common.synchronization [req-5a2e0db9-3ee2-48c1-8c9b-cbf9a92d8f6e req-1eeccd1f-8fa9-48e7-a444-ae9e829b54a0 service nova] Enqueued Resource ID: 45f9e90c-9b95-445a-8c55-a9827dceaca0 with Priority: HIGHEST for action port [ 823.811622] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 823.811934] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 823.812144] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f9e90c-9b95-445a-8c55-a9827dceaca0 with Priority: HIGHEST for action port [ 823.812947] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.812947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.812947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.812947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.813171] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.815161] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.815809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.816037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-45f9e90c-9b95-445a-8c55-a9827dceaca0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.816182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45f9e90c-9b95-445a-8c55-a9827dceaca0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.816526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45f9e90c-9b95-445a-8c55-a9827dceaca0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.816784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45f9e90c-9b95-445a-8c55-a9827dceaca0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.816902] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f9e90c-9b95-445a-8c55-a9827dceaca0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.859833] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.172171] env[66157]: INFO networking_nsxv3.common.synchronization [None req-13b8a36d-2b07-4b93-a55b-31d0c07d2adb None None] Enqueued Resource ID: 6545cde4-c2a3-4561-8cc6-99bf258ce8b8 with Priority: HIGHEST for action port [ 824.172770] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6545cde4-c2a3-4561-8cc6-99bf258ce8b8 with Priority: HIGHEST for action port [ 824.173235] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-6545cde4-c2a3-4561-8cc6-99bf258ce8b8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.173843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6545cde4-c2a3-4561-8cc6-99bf258ce8b8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.173843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6545cde4-c2a3-4561-8cc6-99bf258ce8b8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.174191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6545cde4-c2a3-4561-8cc6-99bf258ce8b8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.174315] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6545cde4-c2a3-4561-8cc6-99bf258ce8b8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.318724] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.318895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.319132] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45f9e90c-9b95-445a-8c55-a9827dceaca0 with status ACTIVE [ 824.319329] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.319445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.319515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.319729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.319820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.320053] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.320228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.320295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.320473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.320584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.320740] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.320836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.320900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.321058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.321136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.321223] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45f9e90c-9b95-445a-8c55-a9827dceaca0 is going to be updated. [ 824.355218] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.355407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.355451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.355980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.355980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.356089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45f9e90c-9b95-445a-8c55-a9827dceaca0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.361957] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.361957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.361957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.362395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.362395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.362395] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 is going to be updated. [ 824.399104] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.399282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.399355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.399565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.399772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.412046] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: IN_PROGRESS for 2s [ 824.644154] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 824.644298] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 824.644344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.644524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.644799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.645020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.645172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.645204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.645350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.645429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.645526] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.675712] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6545cde4-c2a3-4561-8cc6-99bf258ce8b8 [ 824.675934] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.676071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.676135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.676344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.676428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.676520] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6545cde4-c2a3-4561-8cc6-99bf258ce8b8 already deleted. [ 824.676596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6545cde4-c2a3-4561-8cc6-99bf258ce8b8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.148498] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.654563] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.158236] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.158335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.158415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.158675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.158779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.158906] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 826.194158] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.194438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.194549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.194806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.195067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.207711] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 826.424067] env[66157]: INFO networking_nsxv3.common.synchronization [req-5d67c4db-3bb0-47bc-97fc-a351381b30ec req-545f92ad-4083-4ec3-9625-9919aabeb69b tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 826.426268] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: SUCCESS [ 826.426533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.427063] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 826.427239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.427470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.427905] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.428495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.428600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.428789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.428886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.429145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.429145] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.430409] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.430549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.430603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.431067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.431222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.431321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.431384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.431527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.431605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.431915] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.803783] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-204 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.804154] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-204" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.804154] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-204" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.804412] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-204" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.805216] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.805216] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.805216] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.805216] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.805966] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.805966] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.805966] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.805966] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.805966] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.806368] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.806368] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.806368] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.835067] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.835749] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.836018] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.836498] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-204" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.836681] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-366325bc-0c2d-4425-9fe8-d665c33b42e0 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.836913] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.837238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.837833] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.837833] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('366325bc-0c2d-4425-9fe8-d665c33b42e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.935034] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.935034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.935287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.935417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.935616] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.935748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.935916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.936120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.936251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.936354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.936512] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.936606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.936669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.936824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.937006] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.937114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.937175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.937325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.937401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.937626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.937737] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.938849] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.938985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.940181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.940181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.940181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.940181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.940181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.940181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.940181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.940181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.940181] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 already deleted. [ 826.940181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.341165] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.341502] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.341727] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.342040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.342215] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.342376] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 366325bc-0c2d-4425-9fe8-d665c33b42e0 not found, creating... [ 827.342647] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.342817] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.342936] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.343175] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.343323] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.343634] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.343785] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.343895] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.344109] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.344235] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.344365] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 is going to be created. [ 827.375347] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.375524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.375628] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.375963] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.376226] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.376459] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.441447] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1: rpc.has_security_group_logging(os_id): False [ 827.464185] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.466080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.466080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.466080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.489050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.489050] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.489050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.489050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.489615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.489615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.489615] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.489615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.489615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.489973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.489973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.490109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.490256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.490256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.490324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.490404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.490511] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 is going to be updated. [ 827.578679] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.578864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.578947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.579245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.579413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.594279] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: IN_PROGRESS for 2s [ 827.979114] env[66157]: INFO networking_nsxv3.common.synchronization [req-5b050af1-c48c-4046-b094-739eb2b02239 req-2a2aaca5-aed8-48ef-ad31-024f60fa209d tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 827.979740] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 827.980089] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.980239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.980313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.980543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.980728] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.980929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.980929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.981068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.981192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.981312] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.098606] env[66157]: INFO networking_nsxv3.common.synchronization [req-5d67c4db-3bb0-47bc-97fc-a351381b30ec req-7161b168-d8af-4e4e-88b5-d821c3594e46 service nova] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 828.098772] env[66157]: INFO networking_nsxv3.common.synchronization [req-5d67c4db-3bb0-47bc-97fc-a351381b30ec req-7161b168-d8af-4e4e-88b5-d821c3594e46 service nova] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 828.098911] env[66157]: INFO networking_nsxv3.common.synchronization [req-5d67c4db-3bb0-47bc-97fc-a351381b30ec req-7161b168-d8af-4e4e-88b5-d821c3594e46 service nova] Enqueued Resource ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 with Priority: HIGHEST for action port [ 828.099500] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 828.099610] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 828.099714] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 with Priority: HIGHEST for action port [ 828.100343] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.100473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.100585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.100847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.100936] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.101802] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.101927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.101996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.102180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.102329] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.102424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.102488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.102623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.102706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.102799] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.103543] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-366325bc-0c2d-4425-9fe8-d665c33b42e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.103649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.104749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.104931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.105024] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('366325bc-0c2d-4425-9fe8-d665c33b42e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.219636] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 4s [ 828.483983] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.484161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.484233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.484465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.484550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.484754] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.485064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.485064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.485064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.485172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.485207] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 828.519290] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.519378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.519462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.521191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.521191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.529596] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 828.607272] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.607361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.607537] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.608539] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 366325bc-0c2d-4425-9fe8-d665c33b42e0 with status ACTIVE [ 828.608718] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.608874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.608942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.609111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.609228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.609445] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.609546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.609603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.609766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.609845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.610031] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.610125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.610220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.610354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.610454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.610501] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 is going to be updated. [ 828.634789] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.634941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.635028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.635240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.635376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.635535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.112507] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.613805] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: SUCCESS [ 829.614602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.615221] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.615697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.615848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.616173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.616292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.616393] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be created. [ 829.649254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.649254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.649254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.649478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.649788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.663806] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: UNINITIALIZED for 2s [ 830.235996] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 830.235996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.236483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.236483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.236630] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.236921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.236921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.237384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.237384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.237384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.237384] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.542024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 830.542157] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef deletion is rescheduled due to dependency. [ 830.542294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.741154] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.741154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.741154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.741154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.741154] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.741520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.741520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.741520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.741520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.741520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.741749] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.741749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.741855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.741954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.742110] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.742198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.742252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.742385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.742511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.742565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.742615] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.069796] env[66157]: INFO networking_nsxv3.common.synchronization [req-636a7bbc-329a-49eb-baf0-9e3b06cec19a req-1de03c9f-d3db-44f5-8b64-a295c0d0c041 tempest-FloatingIPsAssociationNegativeTestJSON-1153726644 tempest-FloatingIPsAssociationNegativeTestJSON-1153726644-project-member] Enqueued Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGHEST for action security_group_members [ 831.073392] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGHEST for action security_group_members [ 831.073392] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-74a77e67-2ad3-434b-99a3-df9c4d1391b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.073392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.073392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.073392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.073392] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.073392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.073392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.073392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.073392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.073392] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.244853] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7e2acfe-17af-4683-bd94-9fc47ded2886: rpc.has_security_group_logging(os_id): False [ 831.263530] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.264520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.264520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.264520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.264520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.264520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.264520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.264520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.264520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.264895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.264895] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.264895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.264895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.265024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.265086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.265254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.265330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.265387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.265518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.265589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.265691] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 831.333792] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.333993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.333993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.334197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.334402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.349508] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 831.577553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.577702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.577773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.578111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.578357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.578654] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.578764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.579630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.579630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.579630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.579630] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 is going to be updated. [ 831.608184] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.608336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.608672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.608672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.608783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.620503] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 in Status: IN_PROGRESS for 2s [ 831.678359] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 831.678578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.678749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.678994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.679193] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.679445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.679445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.679585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.679585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.679680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.679761] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.889683] env[66157]: INFO networking_nsxv3.common.synchronization [req-55a18608-2307-416e-b803-61cf19b77c33 req-4b1f2728-5d35-4e7c-935d-616541c459c1 tempest-ServersAdminNegativeTestJSON-2016589142 tempest-ServersAdminNegativeTestJSON-2016589142-project-member] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 831.890056] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 831.890413] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.890643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.890999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.891144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.891407] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.891517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.891621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.891837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.891992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.892155] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.183189] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.183449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.183449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.183665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.183836] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.183937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.184036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.184167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.184254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.184353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.184532] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.184639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.184685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.184801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.184934] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.185035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.185092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.185229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.185306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.185392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.185489] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.395324] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.688047] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4339fe92-f605-41dc-aba6-ccecae77b024: rpc.has_security_group_logging(os_id): False [ 832.707475] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.707625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.707917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.707917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.708050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.708240] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.708372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.708409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.708570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.708670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.708860] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.708967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.709142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.709261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.709352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.709548] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.709642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.709701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.710350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.710350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.710350] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be created. [ 832.768296] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.768296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.768296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.768647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.768795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.785443] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 832.897830] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.364700] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 833.364975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.400895] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.401336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.401383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.401626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.401727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.401865] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be updated. [ 833.432812] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.433041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.433146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.433333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.433482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.443168] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: IN_PROGRESS for 2s [ 833.633322] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 in Status: SUCCESS [ 833.633515] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 deletion is rescheduled due to dependency. [ 833.633636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.803153] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 834.803494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.456318] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: SUCCESS [ 835.456557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.929607] env[66157]: INFO networking_nsxv3.common.synchronization [req-40fc1b15-e0d2-4f5a-946d-f93f047b3c6c req-bb9054df-2828-4e77-8878-b6a08364c495 tempest-ServerPasswordTestJSON-1157897379 tempest-ServerPasswordTestJSON-1157897379-project-member] Enqueued Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGHEST for action security_group_members [ 835.930635] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGHEST for action security_group_members [ 835.930908] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.931072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.931139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.931366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.931519] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.931650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.931698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.931834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.931914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.932292] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.290065] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.290740] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-344" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.290740] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-344" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.290868] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-344" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.291062] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.291223] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.291355] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.291540] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.291683] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.291896] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.292012] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.292121] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.292223] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.292328] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.292427] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.292554] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.313567] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.313753] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 836.313855] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.314033] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-344" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.314348] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-0023f34b-ec32-4758-b527-14a9e854d6a6 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.314521] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-0023f34b-ec32-4758-b527-14a9e854d6a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.314634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-0023f34b-ec32-4758-b527-14a9e854d6a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.314955] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-0023f34b-ec32-4758-b527-14a9e854d6a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.315100] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0023f34b-ec32-4758-b527-14a9e854d6a6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.436437] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.436437] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.436437] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 already deleted. [ 836.436437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.817790] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.818018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.818151] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.818484] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.818631] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.818779] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 0023f34b-ec32-4758-b527-14a9e854d6a6 not found, creating... [ 836.819083] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.819201] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.819503] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.819569] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.819668] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.819939] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.820100] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.820212] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.820425] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.820564] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.820705] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 0023f34b-ec32-4758-b527-14a9e854d6a6 is going to be created. [ 836.843623] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.843766] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.843900] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.844158] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.844388] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.844654] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-0023f34b-ec32-4758-b527-14a9e854d6a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.624426] env[66157]: INFO networking_nsxv3.common.synchronization [req-40fc1b15-e0d2-4f5a-946d-f93f047b3c6c req-be111a13-2208-4795-86ae-674fe7f26abc service nova] Enqueued Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGHEST for action security_group_rules [ 837.624842] env[66157]: INFO networking_nsxv3.common.synchronization [req-40fc1b15-e0d2-4f5a-946d-f93f047b3c6c req-be111a13-2208-4795-86ae-674fe7f26abc service nova] Enqueued Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGHEST for action security_group_members [ 837.625028] env[66157]: INFO networking_nsxv3.common.synchronization [req-40fc1b15-e0d2-4f5a-946d-f93f047b3c6c req-be111a13-2208-4795-86ae-674fe7f26abc service nova] Enqueued Resource ID: 0023f34b-ec32-4758-b527-14a9e854d6a6 with Priority: HIGHEST for action port [ 837.625615] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGHEST for action security_group_rules [ 837.625762] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGHEST for action security_group_members [ 837.625859] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023f34b-ec32-4758-b527-14a9e854d6a6 with Priority: HIGHEST for action port [ 837.626425] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.626551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.626620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.626883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.626966] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.628136] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.628287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.628375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.629127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.629127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.629274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.629373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.629750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.629750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.629898] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.630857] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0023f34b-ec32-4758-b527-14a9e854d6a6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.630984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0023f34b-ec32-4758-b527-14a9e854d6a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.630984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0023f34b-ec32-4758-b527-14a9e854d6a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.631195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0023f34b-ec32-4758-b527-14a9e854d6a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.631295] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0023f34b-ec32-4758-b527-14a9e854d6a6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.133689] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.135134] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.135268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.135466] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0023f34b-ec32-4758-b527-14a9e854d6a6 with status ACTIVE [ 838.135657] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.135775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.137504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.137504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.137504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.137504] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0023f34b-ec32-4758-b527-14a9e854d6a6 is going to be updated. [ 838.159732] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.159883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.159919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.160120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.160260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.160418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0023f34b-ec32-4758-b527-14a9e854d6a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.640693] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.143527] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.146031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.146031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.146031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.146031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.146031] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 is going to be created. [ 839.175125] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.175347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.175446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.175675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.175912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.192536] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 in Status: UNINITIALIZED for 2s [ 839.984505] env[66157]: INFO networking_nsxv3.common.synchronization [req-6154a15a-3460-4d4c-bf42-7a035931a1ed req-48057c5a-701b-4bbe-8937-8df65c6e6422 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 839.985153] env[66157]: INFO networking_nsxv3.common.synchronization [req-6154a15a-3460-4d4c-bf42-7a035931a1ed req-48057c5a-701b-4bbe-8937-8df65c6e6422 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 839.985191] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 839.985325] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 839.985590] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.985833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.985833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.986186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.986186] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.986273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.986344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.987063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.987063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.987063] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.987580] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.987580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.988610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.988610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.988610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.988610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.988610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.988610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.988610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.988852] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.038748] env[66157]: INFO networking_nsxv3.common.synchronization [req-6154a15a-3460-4d4c-bf42-7a035931a1ed req-48057c5a-701b-4bbe-8937-8df65c6e6422 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_rules [ 840.038748] env[66157]: INFO networking_nsxv3.common.synchronization [req-6154a15a-3460-4d4c-bf42-7a035931a1ed req-48057c5a-701b-4bbe-8937-8df65c6e6422 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 840.038950] env[66157]: INFO networking_nsxv3.common.synchronization [req-6154a15a-3460-4d4c-bf42-7a035931a1ed req-48057c5a-701b-4bbe-8937-8df65c6e6422 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 840.039078] env[66157]: INFO networking_nsxv3.common.synchronization [req-6154a15a-3460-4d4c-bf42-7a035931a1ed req-48057c5a-701b-4bbe-8937-8df65c6e6422 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 840.039275] env[66157]: INFO networking_nsxv3.common.synchronization [req-6154a15a-3460-4d4c-bf42-7a035931a1ed req-48057c5a-701b-4bbe-8937-8df65c6e6422 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 with Priority: HIGHEST for action port [ 840.039844] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_rules [ 840.039991] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 840.040113] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 with Priority: HIGHEST for action port [ 840.040320] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 840.040320] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 840.040600] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.040719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.040779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.041145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.041145] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.042075] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.042991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.042991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.042991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.042991] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.044117] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-366325bc-0c2d-4425-9fe8-d665c33b42e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.044117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.044117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.044117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.044117] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('366325bc-0c2d-4425-9fe8-d665c33b42e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.045367] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.045367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.045367] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.045367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.490183] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.491230] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.546317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.546455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.546680] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.546798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.546958] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 366325bc-0c2d-4425-9fe8-d665c33b42e0 with status ACTIVE [ 840.547150] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.547375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.547375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.548429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.548429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.548429] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.548429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.548429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.548429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.548429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.548682] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.548682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.548682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.548986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.548986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.549839] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 is going to be updated. [ 840.575288] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.575466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.575466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.575729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.575821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.575944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.962277] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGHEST for action security_group_members [ 840.962277] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 840.964192] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 840.964907] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGHEST for action security_group_members [ 840.965149] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 840.965216] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 840.965542] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-58626db2-1bef-478d-8fe6-5cb88f964fa3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.966472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.966472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.966472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.966472] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.966472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.966472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.966905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.966905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.966905] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.967830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.967830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.968673] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.968673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.992481] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.993528] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.023958] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_rules [ 841.024348] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 841.024606] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 841.024824] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 841.025092] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGHEST for action security_group_rules [ 841.025319] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGHEST for action security_group_members [ 841.025569] env[66157]: INFO networking_nsxv3.common.synchronization [req-08990bc5-34fd-4657-a3d0-3c4be59a77ad req-213c9e88-8e67-4151-98e6-f0c4e8d43d1d tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 with Priority: HIGHEST for action port [ 841.026708] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_rules [ 841.026843] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 841.027044] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGHEST for action security_group_members [ 841.027314] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 with Priority: HIGHEST for action port [ 841.027492] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGHEST for action security_group_rules [ 841.027694] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 841.027886] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 841.028769] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.028998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.029182] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.029276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.029627] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-58626db2-1bef-478d-8fe6-5cb88f964fa3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.029720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.029918] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-366325bc-0c2d-4425-9fe8-d665c33b42e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.030060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.030126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.030343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.030428] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('366325bc-0c2d-4425-9fe8-d665c33b42e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.033219] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58626db2-1bef-478d-8fe6-5cb88f964fa3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.033362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.034024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.034024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.034024] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.037641] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.037641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.037641] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.037641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.205898] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 in Status: SUCCESS [ 841.206932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.206932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.206932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.206932] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.206932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.210689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.210689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.210689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.210689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.210689] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.468941] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.495175] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.495331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.495382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.495739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.495739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.495843] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba is going to be created. [ 841.497360] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.497660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.497660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.497895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.498110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.498262] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 841.531758] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.531969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.531969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.532208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.532370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.535061] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.535251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.535251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.535450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.536056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.537216] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-58626db2-1bef-478d-8fe6-5cb88f964fa3 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.537408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.538647] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 366325bc-0c2d-4425-9fe8-d665c33b42e0 with status ACTIVE [ 841.539076] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.539194] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.539270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.539492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.539655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.539830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.539936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.539992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.540142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.540220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.540403] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.540496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.540571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.540712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.540815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.540919] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 366325bc-0c2d-4425-9fe8-d665c33b42e0 is going to be updated. [ 841.547071] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: UNINITIALIZED for 2s [ 841.551854] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 841.566713] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.566816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.566899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.567191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.567546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.567546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-366325bc-0c2d-4425-9fe8-d665c33b42e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.710361] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.710361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.710564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.710691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.710954] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.711078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.711181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.711304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.711617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.711617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.711799] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.711853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.711889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.712375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.712375] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.712375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.712375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.712576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.712576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.712576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.712665] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.971873] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.214778] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24: rpc.has_security_group_logging(os_id): False [ 842.246392] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.246659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.246659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.247081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.247081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.247317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.247317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.247317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.247603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.247603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.247696] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.250180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.250180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.250180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.250180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.250180] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.250180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.250180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.250180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.250180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.250180] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 is going to be created. [ 842.359783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.360245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.360245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.360641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.360999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.382181] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 in Status: IN_PROGRESS for 2s [ 842.474877] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.475175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.475175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.475292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.475414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.475499] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 is going to be created. [ 842.500749] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.500965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.500965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.502065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.502065] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.510659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.511065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.511065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.511161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.511276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.522612] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 in Status: UNINITIALIZED for 2s [ 843.006533] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.513402] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.559858] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: SUCCESS [ 843.560109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.560281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.560507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.560707] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.560908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.560908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.561169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.561258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.561368] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.563012] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 843.563191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.563370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.563757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.563924] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.564256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.564326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.564466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.564546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.564637] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.877684] env[66157]: INFO networking_nsxv3.common.synchronization [req-a58aebe6-9214-4471-bec2-702f5aff197d req-c6562146-fb8a-4a04-89d0-fc7e0e0d8950 tempest-ServersTestJSON-688042915 tempest-ServersTestJSON-688042915-project-member] Enqueued Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_members [ 843.878255] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_members [ 843.881965] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93b3d3-7a24-441f-88d0-38d5293ec145 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.881965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.881965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.881965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.881965] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.881965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.881965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.881965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.881965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.881965] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.019741] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 844.019876] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 844.069134] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.070345] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.383915] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.384086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.384164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.384377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.384459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.384672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.385504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.385504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.385504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.385504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.385504] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 already deleted. [ 844.385504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.399487] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 in Status: SUCCESS [ 844.399844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.544595] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 in Status: SUCCESS [ 844.544595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.546667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.546667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.546667] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.546667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.546667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.546667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.546667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.546667] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.575208] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.576482] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.754103] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.754850] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-791" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.758032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-791" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.758032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-791" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.758032] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.758032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.758032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.758032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.758032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.758032] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.758032] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.758032] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.758032] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.758032] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.758032] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.758032] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.781072] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.781310] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.781605] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.781826] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-791" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.782191] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-f54b5810-011a-4312-82c8-dcf06f8829d6 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.782366] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-f54b5810-011a-4312-82c8-dcf06f8829d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.782478] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-f54b5810-011a-4312-82c8-dcf06f8829d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.782802] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-f54b5810-011a-4312-82c8-dcf06f8829d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.782946] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f54b5810-011a-4312-82c8-dcf06f8829d6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.893686] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.893842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.893954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.894137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.910211] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 844.911361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.912413] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 844.939940] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.940100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.940164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.940379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.946695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.947255] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 844.947336] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 844.947418] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 844.981120] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.981322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.981322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.983783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.983783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.983783] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 845.011736] env[66157]: INFO networking_nsxv3.common.synchronization [None req-add433ac-00bd-4680-b5d9-86e12912bdf7 tempest-ServerRescueNegativeTestJSON-2006998581 tempest-ServerRescueNegativeTestJSON-2006998581-project-member] Enqueued Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_rules [ 845.012284] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_rules [ 845.012592] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-099cf4d4-ded3-44df-b6e7-328bc3763be6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.012806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.012806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.013034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.013181] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.046788] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.047078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.047078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.047225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.047425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.047690] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 845.048725] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.079586] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.079862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.079981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.080313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.080452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.080561] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 845.081859] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.082071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.082183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.082483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.082817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.082975] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba is going to be updated. [ 845.117989] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.118228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.118317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.118580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.118813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.119054] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:31. [ 845.119143] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e9050a2e-a60d-4614-aa8f-0f8639b64779', '06552dc4-54b0-463a-af1a-33bc39af0c0c', 'aa17bf86-d9f7-4a25-9da0-fb074266f0a1', '49906db7-3f5d-403d-a6f1-f890089ce428', '62b70f12-d63b-40fb-b48e-a611590fad1f', '74a77e67-2ad3-434b-99a3-df9c4d1391b9', '8851c268-64f4-45b7-bb1b-82bd0da298c8', '3dca9267-bc95-42c2-accb-8a02b78bd970', '222383c0-b19b-4725-af40-286f27465c68', 'da4877d5-58b5-4fb9-8430-89b4ff018611', 'fc8d54c1-30b0-4581-9d61-8b194199903c', 'cd4d34e1-d4d8-4980-86c7-3c5c3b76571b', '00106a4a-ef70-4397-a8b9-afffa44e977b', 'f7e2acfe-17af-4683-bd94-9fc47ded2886', 'c4915dbf-d6e2-46dd-8508-11f50b8da0ef', '7a251e98-2d26-4017-96a0-c67e8ea7efc0', '83c10e8c-149e-450b-b827-98a5e9d401e0', '8c792349-7376-489a-b7da-3c608db236ad', '13cfa8de-e28e-458d-8572-75b45f56b222', '2381db7b-1b29-4dfc-a6af-48c498e3e0b0', '4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1', '82429466-a5a1-4b39-8d12-17fe5aa80977', '8a39b75b-de15-457f-a080-b14841d7ea90', '7b48ccef-7f9a-4d48-8b46-294031485bbd', '4339fe92-f605-41dc-aba6-ccecae77b024', '21980f25-eb0b-4647-8b51-f835b6f941ea', '65e20f28-433e-4752-bdc0-b5f939f691d0', '68270d8f-ab80-474f-8966-489611b2e965', 'b5b02819-f659-4343-b709-2e63116c5829', 'd5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24', 'a38d5e1a-6785-4c65-98b8-9c43e55d070c'} {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 845.119234] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 845.122441] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.122591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.122638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.122794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.122928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.124528] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.124636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.124724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.124881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.125112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.138559] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 845.139606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: IN_PROGRESS for 2s [ 845.143035] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.143035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.143035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.143035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.143035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.143035] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 845.143035] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 845.143035] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 845.146093] env[66157]: INFO networking_nsxv3.common.synchronization [None req-03fbdde1-a113-4b9f-b3ed-7b9389931e03 tempest-ServerRescueNegativeTestJSON-2006998581 tempest-ServerRescueNegativeTestJSON-2006998581-project-member] Enqueued Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_rules [ 845.146692] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_rules [ 845.147118] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-099cf4d4-ded3-44df-b6e7-328bc3763be6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.147439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.202485] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.202651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.202736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.202911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.203592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.203790] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 845.203894] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 845.203950] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 845.203991] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 845.204078] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/31 resources of Type:Security Group Rules [ 845.204145] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGH for action security_group_rules [ 845.204219] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGH for action security_group_rules [ 845.204284] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGH for action security_group_rules [ 845.204346] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGH for action security_group_rules [ 845.204406] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGH for action security_group_rules [ 845.204470] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGH for action security_group_rules [ 845.204532] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGH for action security_group_rules [ 845.204594] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGH for action security_group_rules [ 845.204689] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGH for action security_group_rules [ 845.204760] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGH for action security_group_rules [ 845.204823] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGH for action security_group_rules [ 845.204882] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGH for action security_group_rules [ 845.204942] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGH for action security_group_rules [ 845.205013] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGH for action security_group_rules [ 845.205075] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGH for action security_group_rules [ 845.205136] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGH for action security_group_rules [ 845.205289] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGH for action security_group_rules [ 845.205355] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGH for action security_group_rules [ 845.205418] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGH for action security_group_rules [ 845.205480] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGH for action security_group_rules [ 845.205575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.285876] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.286122] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.286243] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.286533] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.286807] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.286807] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port f54b5810-011a-4312-82c8-dcf06f8829d6 not found, creating... [ 845.287217] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.287373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.287484] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.287700] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.287829] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.288113] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.288259] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.288368] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.288619] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.288756] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.288922] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: f54b5810-011a-4312-82c8-dcf06f8829d6 is going to be created. [ 845.323650] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.324014] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.324093] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.324429] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.325020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.325115] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-f54b5810-011a-4312-82c8-dcf06f8829d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.538424] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.538869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.538869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.539087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.539128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.539204] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 already deleted. [ 845.539292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.539515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.539953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.539953] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.551146] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.052746] env[66157]: INFO networking_nsxv3.common.synchronization [req-a58aebe6-9214-4471-bec2-702f5aff197d req-79b3898e-2d35-4319-bbc2-51d592b605bc service nova] Enqueued Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_rules [ 846.052903] env[66157]: INFO networking_nsxv3.common.synchronization [req-a58aebe6-9214-4471-bec2-702f5aff197d req-79b3898e-2d35-4319-bbc2-51d592b605bc service nova] Enqueued Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_members [ 846.053051] env[66157]: INFO networking_nsxv3.common.synchronization [req-a58aebe6-9214-4471-bec2-702f5aff197d req-79b3898e-2d35-4319-bbc2-51d592b605bc service nova] Enqueued Resource ID: f54b5810-011a-4312-82c8-dcf06f8829d6 with Priority: HIGHEST for action port [ 846.053608] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_rules [ 846.053805] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_members [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54b5810-011a-4312-82c8-dcf06f8829d6 with Priority: HIGHEST for action port [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cfa8de-e28e-458d-8572-75b45f56b222 with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c792349-7376-489a-b7da-3c608db236ad with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGH for action security_group_rules [ 846.055172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGH for action security_group_rules [ 846.055680] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGH for action security_group_rules [ 846.055680] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGH for action security_group_rules [ 846.055680] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGH for action security_group_rules [ 846.055680] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4877d5-58b5-4fb9-8430-89b4ff018611 with Priority: HIGH for action security_group_rules [ 846.055680] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGH for action security_group_rules [ 846.055680] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 with Priority: HIGH for action security_group_rules [ 846.055974] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 with Priority: HIGH for action security_group_rules [ 846.057057] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGH for action security_group_rules [ 846.057057] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c with Priority: HIGH for action security_group_rules [ 846.057057] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49906db7-3f5d-403d-a6f1-f890089ce428 with Priority: HIGH for action security_group_rules [ 846.057248] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.057328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.057380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.057558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.057770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.057871] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 is going to be updated. [ 846.059721] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b93b3d3-7a24-441f-88d0-38d5293ec145 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.059912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.060136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.060267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.060391] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.063786] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93b3d3-7a24-441f-88d0-38d5293ec145 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.063786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.063786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.063786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.063786] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.063786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.063786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.063786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.063786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.063786] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.064933] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-f54b5810-011a-4312-82c8-dcf06f8829d6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.064933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f54b5810-011a-4312-82c8-dcf06f8829d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.064933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f54b5810-011a-4312-82c8-dcf06f8829d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.065197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f54b5810-011a-4312-82c8-dcf06f8829d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.065197] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f54b5810-011a-4312-82c8-dcf06f8829d6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.067753] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9050a2e-a60d-4614-aa8f-0f8639b64779 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.067753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.067753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.067753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.067753] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9050a2e-a60d-4614-aa8f-0f8639b64779',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.067753] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.067753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.067753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.068410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.068410] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa17bf86-d9f7-4a25-9da0-fb074266f0a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.069188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8851c268-64f4-45b7-bb1b-82bd0da298c8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.069348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.069348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.070072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.070072] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8851c268-64f4-45b7-bb1b-82bd0da298c8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.071530] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.071530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.071530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.071530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.071530] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.075445] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.075445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.075445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.075445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.075445] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.075445] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13cfa8de-e28e-458d-8572-75b45f56b222 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.075445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.075445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.075445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.075445] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13cfa8de-e28e-458d-8572-75b45f56b222',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.076533] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c792349-7376-489a-b7da-3c608db236ad taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.076533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.076533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.076533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.076533] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c792349-7376-489a-b7da-3c608db236ad',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.081311] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.081311] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.081311] env[66157]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 846.081311] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.081311] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.081311] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.081311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.081311] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.082197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.082197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.082197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.082878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.082878] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.082878] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.082878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.084014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.084014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.084014] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.084778] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.084888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.084888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.085093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.086020] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.086201] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da4877d5-58b5-4fb9-8430-89b4ff018611 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.086201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.086396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.086396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.086502] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da4877d5-58b5-4fb9-8430-89b4ff018611',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.087708] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.087708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.087708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.087708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.087708] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.088553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.088662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.088662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.089354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.089354] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74a77e67-2ad3-434b-99a3-df9c4d1391b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.089816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3dca9267-bc95-42c2-accb-8a02b78bd970 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.090420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.090420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.090420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.090420] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3dca9267-bc95-42c2-accb-8a02b78bd970',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.091095] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.091197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.091258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.091425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.091485] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.091683] env[66157]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 846.092334] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06552dc4-54b0-463a-af1a-33bc39af0c0c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.092430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.093038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.093038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.093038] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06552dc4-54b0-463a-af1a-33bc39af0c0c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.093582] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49906db7-3f5d-403d-a6f1-f890089ce428 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.093681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.093743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.093984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.094057] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49906db7-3f5d-403d-a6f1-f890089ce428',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.099531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.099531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.099531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.099531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.099531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.099531] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 already deleted. [ 846.099531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.289750] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.289750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.289750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.289750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.289750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.311453] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 in Status: IN_PROGRESS for 2s [ 846.564181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93b3d3-7a24-441f-88d0-38d5293ec145 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.564428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.601093] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.602456] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f54b5810-011a-4312-82c8-dcf06f8829d6 with status ACTIVE [ 846.602673] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.602796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.602861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.603373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.603613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.603962] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.605249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.605249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.605249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.605249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.605249] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.605249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.605249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.605249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.605249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.605859] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f54b5810-011a-4312-82c8-dcf06f8829d6 is going to be updated. [ 846.646588] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.646801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.646878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.647161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.656773] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.656922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.656983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.657209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.657346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.657521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f54b5810-011a-4312-82c8-dcf06f8829d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.669801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.669801] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9050a2e-a60d-4614-aa8f-0f8639b64779 is going to be deleted. [ 846.754594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.754763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.754834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.755060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.756039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.756039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9050a2e-a60d-4614-aa8f-0f8639b64779" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.794583] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.795480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.795660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.795988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.796209] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.796330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.796398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.796577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.796655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.796758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.796918] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.798778] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.798778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.798888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.799055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.799127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.799260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.799297] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.799411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.799493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.799582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.799690] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.800551] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.800690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.800785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.800966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.801204] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.801306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.801369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.801780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.801780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.801780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.801780] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.802552] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.802652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.802705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.803199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.803199] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.803199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.803199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.803404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.803404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.803527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.803527] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.804334] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.804443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.804509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.804656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.804799] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.804890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.804949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.805093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.805167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.805244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.805326] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.810032] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.810032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.810032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.810244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.810352] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.810471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.810533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.810710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.810792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.810907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.811839] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.816289] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.816494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.816494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.816722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.819166] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.819166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.819485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.819485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.819742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.819742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.819840] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.824982] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.825175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.825266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.825455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.825615] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.825714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.825775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.825917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.825998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.826112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.826206] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.835386] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.835561] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.835640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.835846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.896162] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.896162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.902228] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.902417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.904091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.904091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.904694] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.904869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.906051] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.906051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.906616] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.906694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.907957] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.908076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.909777] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.909878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.910775] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.911039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.911744] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.911842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.913359] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 846.913783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.913899] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06552dc4-54b0-463a-af1a-33bc39af0c0c is going to be deleted. [ 846.914798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.915027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.937663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.937822] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa17bf86-d9f7-4a25-9da0-fb074266f0a1 is going to be deleted. [ 846.938772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.938987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.967057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.967057] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13cfa8de-e28e-458d-8572-75b45f56b222 is going to be deleted. [ 846.967412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.967547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.992420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.992551] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da4877d5-58b5-4fb9-8430-89b4ff018611 is going to be deleted. [ 846.993731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.994061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.008831] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.011819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.036824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.036824] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be deleted. [ 847.036824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.036824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.062071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.062282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.063083] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.063216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.071673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.071838] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8851c268-64f4-45b7-bb1b-82bd0da298c8 is going to be deleted. [ 847.073173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.074597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.108167] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.123728] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.123892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.127964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.128162] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74a77e67-2ad3-434b-99a3-df9c4d1391b9 is going to be deleted. [ 847.129187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.129408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.155632] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: SUCCESS [ 847.155865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.156872] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 847.156872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.157340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.157545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.157732] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.157844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.157964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.158180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.158299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.158403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.158554] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.159465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.159679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.159868] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.159982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.160059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.160211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.160290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.160374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.160466] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.162895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.162895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.162895] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.162895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.162895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.162895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.162895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.162895] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.162895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.163254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.163254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.163254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.163254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.163401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.164441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.164441] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.165212] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.165311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.170106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.170234] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c792349-7376-489a-b7da-3c608db236ad is going to be deleted. [ 847.171365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.171686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.218636] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.218636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.231129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.231277] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3dca9267-bc95-42c2-accb-8a02b78bd970 is going to be deleted. [ 847.232231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.233059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.234077] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.234239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.304889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.304889] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be deleted. [ 847.305893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.306552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.328197] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.329229] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.330860] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.331055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.331136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.332028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.332028] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.332028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.332028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.332028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.332028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.332277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.332277] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.332361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.332444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.332596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.332737] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.332822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.332877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.333233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.333307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.333388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.333469] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.334263] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.337063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.337063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.337313] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.337422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.337486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.337733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.337806] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.337876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.339062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.339062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.339062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.339062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.339062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.339062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.339062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.339062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.339062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.341128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.341128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.341128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.341128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.341128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.341128] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.341128] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.341128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.341128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.341128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.341482] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.341482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.341482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.341582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.341582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.341688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.341820] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.341909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.341968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.342116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.342243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.342346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.342386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.342511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.342638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.342685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.342722] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.343970] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.344257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.344257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.344378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.344557] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.344651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.344716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.344865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.344966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.345129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.345211] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.345331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.345389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.345553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.345852] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.345852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.345852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.345996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.345996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.346090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.346176] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.347034] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.347147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.347216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.347379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.347520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.347635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.347704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.347841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.347915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.347997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.348152] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.348242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.348299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.348456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.348618] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.348707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.349023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.349023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.349023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.349152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.349152] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.369291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.369291] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49906db7-3f5d-403d-a6f1-f890089ce428 is going to be deleted. [ 847.370410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.370638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.370745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.370868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06552dc4-54b0-463a-af1a-33bc39af0c0c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.371397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.371599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.371686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.371810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa17bf86-d9f7-4a25-9da0-fb074266f0a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.372704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.372901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.372987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.373121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13cfa8de-e28e-458d-8572-75b45f56b222" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.373359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.373454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.373499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.373585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da4877d5-58b5-4fb9-8430-89b4ff018611" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.373717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.373855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.373928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.374060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.374189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.374325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.374468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.374530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8851c268-64f4-45b7-bb1b-82bd0da298c8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.374616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.374753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.374815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.374924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74a77e67-2ad3-434b-99a3-df9c4d1391b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.375064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.375203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.375282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.375407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c792349-7376-489a-b7da-3c608db236ad" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.397516] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.398049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.398049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.398049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.398197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.398197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3dca9267-bc95-42c2-accb-8a02b78bd970" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.513795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.513795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.513795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.513795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.513795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.513795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.517807] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.517931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.518024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.518240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.518334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.518497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49906db7-3f5d-403d-a6f1-f890089ce428" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.611058] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.611368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.611368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.611483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.611555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.611650] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 is going to be created. [ 847.641340] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.641612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.641707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.642680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.642680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.662917] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.665338] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 in Status: UNINITIALIZED for 2s [ 847.665645] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.665755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.666067] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.666739] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.830904] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2381db7b-1b29-4dfc-a6af-48c498e3e0b0: rpc.has_security_group_logging(os_id): False [ 847.832129] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc8d54c1-30b0-4581-9d61-8b194199903c: rpc.has_security_group_logging(os_id): False [ 847.837341] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd4d34e1-d4d8-4980-86c7-3c5c3b76571b: rpc.has_security_group_logging(os_id): False [ 847.838413] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7e2acfe-17af-4683-bd94-9fc47ded2886: rpc.has_security_group_logging(os_id): False [ 847.851987] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83c10e8c-149e-450b-b827-98a5e9d401e0: rpc.has_security_group_logging(os_id): False [ 847.854184] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a251e98-2d26-4017-96a0-c67e8ea7efc0: rpc.has_security_group_logging(os_id): False [ 847.854184] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 222383c0-b19b-4725-af40-286f27465c68: rpc.has_security_group_logging(os_id): False [ 847.854804] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 847.856701] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.856861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.856931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.857155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.858694] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.859066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.859811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.859975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.872801] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.872924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.879589] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.879809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.880908] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.880908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.881856] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.881965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.882624] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.882716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.883666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.884020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.884254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.884254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.887357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.887357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.887357] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c is going to be updated. [ 847.887357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.887357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.904222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.904526] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.904624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.904768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.904984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.905080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.905184] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b is going to be updated. [ 847.906281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.906602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.927697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.928013] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.928124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.928193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.928396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.928478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.928574] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 847.929784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.929957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.956083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.957859] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.957859] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.957859] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.957859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.958438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.958438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.958438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.958438] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be updated. [ 847.962019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.962019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.962019] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.962019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.981026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.981026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.996403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.996778] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.996939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.997279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.997279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.997398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.997592] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.997693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.997755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.997917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.997995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.998339] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.998462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.999685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.999685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.999685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.999685] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be updated. [ 848.000419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.000598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.147633] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.147633] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.151464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.151786] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.152028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.152202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.152513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.152677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.153069] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.153216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.153415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.153643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.153802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.154040] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.154169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.154226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.154445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.154552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.154675] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 848.155835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.156033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.165514] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 413d37d4-0b94-44d0-aa20-20a2f41994ba: rpc.has_security_group_logging(os_id): False [ 848.169800] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.171113] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.184915] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.185204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.198881] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.199171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.201298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.201601] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.201742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.201881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.202113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.202226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.202475] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.202601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.202680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.202860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.202962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.203262] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.203378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.203459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.203624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.203735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.203841] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 848.205043] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.205219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.205363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.206497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.206692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.229348] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.229614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.230462] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b in Status: IN_PROGRESS for 2s [ 848.237960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.238207] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.238370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.238453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.238695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.238799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.239074] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.239249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.239402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.239645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.239999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.240273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.240359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.240428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.240807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.240905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.241056] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 848.242293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.242488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.242656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.243724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.243919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.244102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.245098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.245622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.245711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.245976] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.246119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.246253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.246421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.246567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.246713] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba is going to be created. [ 848.248429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.248670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.248799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.250267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.250439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.250616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.287021] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: IN_PROGRESS for 2s [ 848.305744] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc8d54c1-30b0-4581-9d61-8b194199903c in Status: IN_PROGRESS for 2s [ 848.309647] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.310444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.310444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.310444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.310444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.315043] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 848.331117] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: IN_PROGRESS for 2s [ 848.334375] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.334564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.334564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.334792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.335012] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.339623] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 in Status: SUCCESS [ 848.339870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.340133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.340284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.340516] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.340613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.340656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.340789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.340949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.340949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.341074] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.355116] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 848.382229] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 848.398709] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.400428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.400428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.400428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.400428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.415319] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.415319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.415319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.415319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.415319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.443736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: IN_PROGRESS for 2s [ 848.457738] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 848.672754] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.673107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.673107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.673211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.673305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.673402] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba is going to be updated. [ 848.675714] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.675714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.675714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.675714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.675714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.675714] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 848.709191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.709378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.709445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.709644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.709833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.717191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.717191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.717191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.717191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.717191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.727294] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 848.728569] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: IN_PROGRESS for 2s [ 848.843454] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.980529] env[66157]: INFO networking_nsxv3.common.synchronization [None req-4828b547-5456-4860-9495-1cb6b84e44f0 None None] Enqueued Resource ID: 2ecb0575-6843-46e5-a1e9-d68fc88762e8 with Priority: HIGHEST for action port [ 848.981455] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ecb0575-6843-46e5-a1e9-d68fc88762e8 with Priority: HIGHEST for action port [ 848.981873] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ecb0575-6843-46e5-a1e9-d68fc88762e8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.982065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ecb0575-6843-46e5-a1e9-d68fc88762e8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.982065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ecb0575-6843-46e5-a1e9-d68fc88762e8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.982327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ecb0575-6843-46e5-a1e9-d68fc88762e8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.982411] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ecb0575-6843-46e5-a1e9-d68fc88762e8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.986599] env[66157]: INFO networking_nsxv3.common.synchronization [req-19d0aba2-5ab9-4cf3-a1d5-83f1777153f8 req-3c701f65-673c-4e92-a0f2-c93dcfc49c6d tempest-ServersWithSpecificFlavorTestJSON-563142723 tempest-ServersWithSpecificFlavorTestJSON-563142723-project-member] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 848.988215] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 848.988715] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.989120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.989120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.989242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.989610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.989610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.989610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.989935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.989935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.989935] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.345736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58626db2-1bef-478d-8fe6-5cb88f964fa3: rpc.has_security_group_logging(os_id): False [ 849.373089] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-921 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.373330] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-921" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.373460] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-921" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.373729] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-921" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.373998] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.374183] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.374312] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.374548] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.374695] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.374920] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.375042] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.375151] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.375254] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.375361] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.375464] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.375589] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.386436] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.386436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.386436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.386436] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.386436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.386436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.386436] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 is going to be created. [ 849.398022] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.398022] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.398022] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.398022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-921" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.398022] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-71b28b5f-7334-400a-8f76-3dfe93197bec taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.398022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-71b28b5f-7334-400a-8f76-3dfe93197bec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.398365] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-71b28b5f-7334-400a-8f76-3dfe93197bec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.398444] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-71b28b5f-7334-400a-8f76-3dfe93197bec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.398579] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b28b5f-7334-400a-8f76-3dfe93197bec',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.470141] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.470141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.470141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.470316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.470500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.484864] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ecb0575-6843-46e5-a1e9-d68fc88762e8 [ 849.485102] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.485230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.485300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.485511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.485602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.485697] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ecb0575-6843-46e5-a1e9-d68fc88762e8 already deleted. [ 849.485773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ecb0575-6843-46e5-a1e9-d68fc88762e8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.489313] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 in Status: IN_PROGRESS for 2s [ 849.493797] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.493797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.493797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.493797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.493797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.493797] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.493797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.493797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.493797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.493797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.494443] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be deleted. [ 849.545807] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.547227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.547227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.547227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.547227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.547227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.676219] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 in Status: SUCCESS [ 849.676576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.677061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.677948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.677948] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.677948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.677948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.677948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.677948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.678215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.678215] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.707054] env[66157]: INFO networking_nsxv3.common.synchronization [None req-ac7ab9ff-2fd6-4cc9-8fa9-76c34a68ce1f tempest-ServersV294TestFqdnHostnames-725788328 tempest-ServersV294TestFqdnHostnames-725788328-project-member] Enqueued Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_rules [ 849.707790] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_rules [ 849.708240] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.708402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.708497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.708858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.708987] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.852396] env[66157]: INFO networking_nsxv3.common.synchronization [None req-394aaeda-7bdc-4f47-83d9-87345cc7d778 tempest-ServersV294TestFqdnHostnames-725788328 tempest-ServersV294TestFqdnHostnames-725788328-project-member] Enqueued Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_rules [ 849.852924] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_rules [ 849.853245] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.853342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.901500] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.901724] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.901850] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.902149] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.902305] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.902501] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 71b28b5f-7334-400a-8f76-3dfe93197bec not found, creating... [ 849.902715] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.902905] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.902974] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.903205] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.903340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.903622] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.903780] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.903969] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.904090] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.904222] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.904359] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 71b28b5f-7334-400a-8f76-3dfe93197bec is going to be created. [ 849.928682] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.928978] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.929075] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.929344] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.929585] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.929844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-71b28b5f-7334-400a-8f76-3dfe93197bec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.181624] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.231676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.231676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.232094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.232094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.232094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.232185] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 already deleted. [ 850.232216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.233233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.233397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.233483] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.244700] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b in Status: SUCCESS [ 850.244993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.296891] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: SUCCESS [ 850.297170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.330347] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc8d54c1-30b0-4581-9d61-8b194199903c in Status: SUCCESS [ 850.330566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.331760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 850.331975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.343219] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: SUCCESS [ 850.343437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.369629] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 850.369629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.400678] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 850.400909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.460415] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: SUCCESS [ 850.460415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.460415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.460415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.460415] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.470992] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 850.471268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.682877] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b93b3d3-7a24-441f-88d0-38d5293ec145: rpc.has_security_group_logging(os_id): False [ 850.703605] env[66157]: INFO networking_nsxv3.common.synchronization [req-19d0aba2-5ab9-4cf3-a1d5-83f1777153f8 req-75539799-c7e1-42e2-bef1-08f109cdb75d service nova] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_rules [ 850.703605] env[66157]: INFO networking_nsxv3.common.synchronization [req-19d0aba2-5ab9-4cf3-a1d5-83f1777153f8 req-75539799-c7e1-42e2-bef1-08f109cdb75d service nova] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 850.704080] env[66157]: INFO networking_nsxv3.common.synchronization [req-19d0aba2-5ab9-4cf3-a1d5-83f1777153f8 req-75539799-c7e1-42e2-bef1-08f109cdb75d service nova] Enqueued Resource ID: 71b28b5f-7334-400a-8f76-3dfe93197bec with Priority: HIGHEST for action port [ 850.707492] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.707492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.707492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.707492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.707492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.707492] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.707492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.707492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.707492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.707492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.707492] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 is going to be created. [ 850.708054] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_rules [ 850.708191] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 850.708281] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b28b5f-7334-400a-8f76-3dfe93197bec with Priority: HIGHEST for action port [ 850.708555] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.708654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.708749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.708926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.709012] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.709990] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.710063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.710111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.710282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.710385] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.710473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.710570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.710672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.710763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.710841] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.712748] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-71b28b5f-7334-400a-8f76-3dfe93197bec taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.712878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71b28b5f-7334-400a-8f76-3dfe93197bec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.712943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71b28b5f-7334-400a-8f76-3dfe93197bec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.713294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71b28b5f-7334-400a-8f76-3dfe93197bec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.713294] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b28b5f-7334-400a-8f76-3dfe93197bec',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.741419] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 850.741622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.741731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.741934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.742376] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.742376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.742376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.742530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.742530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.742781] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.744170] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: SUCCESS [ 850.744862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.744938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.745077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.745297] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.745392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.745431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.745544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.745616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.745705] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.756643] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.756805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.756882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.757096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.757193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.757290] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 already deleted. [ 850.757369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.797196] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.797382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.797382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.797575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.798070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.809437] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 in Status: IN_PROGRESS for 2s [ 850.962995] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.962995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.214969] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.215040] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71b28b5f-7334-400a-8f76-3dfe93197bec with status ACTIVE [ 851.215269] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.215414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.215534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.215750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.215852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.216069] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.216171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.216232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.216412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.216507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.216703] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.216943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.216943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.220266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.220266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.220266] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71b28b5f-7334-400a-8f76-3dfe93197bec is going to be updated. [ 851.220808] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.220905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.245035] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.245177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.245224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.245430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.245571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.245731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71b28b5f-7334-400a-8f76-3dfe93197bec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.248367] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.249667] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.407872] env[66157]: INFO networking_nsxv3.common.synchronization [None req-b51ece97-96e7-4689-ad2f-ebc525f1f100 None None] Enqueued Resource ID: 561715c5-32b0-41a3-846b-5be70c3a228d with Priority: HIGHEST for action port [ 851.408786] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 561715c5-32b0-41a3-846b-5be70c3a228d with Priority: HIGHEST for action port [ 851.410277] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-561715c5-32b0-41a3-846b-5be70c3a228d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.410594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-561715c5-32b0-41a3-846b-5be70c3a228d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.410724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-561715c5-32b0-41a3-846b-5be70c3a228d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.411397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-561715c5-32b0-41a3-846b-5be70c3a228d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.411579] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('561715c5-32b0-41a3-846b-5be70c3a228d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.506550] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 in Status: SUCCESS [ 851.506988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.722566] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.749504] env[66157]: INFO networking_nsxv3.common.synchronization [req-10a0eaec-8a62-4da0-8a51-65ffd3084aea req-59a67389-4267-494f-9ce5-d0bdb85e45dd tempest-ServerAddressesNegativeTestJSON-1723238863 tempest-ServerAddressesNegativeTestJSON-1723238863-project-member] Enqueued Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGHEST for action security_group_members [ 851.749504] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGHEST for action security_group_members [ 851.749504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bade862-ff24-47f6-913c-4a011dd3df71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.749504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.749504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.749504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.749814] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.749867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.749943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.750170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.750526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.750526] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.754677] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.755694] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.914413] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 561715c5-32b0-41a3-846b-5be70c3a228d [ 851.916120] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.916288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.916421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.916659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.916769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.916876] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:561715c5-32b0-41a3-846b-5be70c3a228d already deleted. [ 851.917014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-561715c5-32b0-41a3-846b-5be70c3a228d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.163286] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.163286] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-939" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.163286] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-939" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.163286] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-939" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.163581] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.163907] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.163907] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.164439] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.164650] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.164849] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.164849] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.164924] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.166279] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.166279] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.166279] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.166279] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.192755] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.193127] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.193280] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.193465] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-939" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.193800] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-b25a35ec-95b7-43e9-b50e-7b0383b89df4 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.193985] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-b25a35ec-95b7-43e9-b50e-7b0383b89df4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.194116] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-b25a35ec-95b7-43e9-b50e-7b0383b89df4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.194444] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-b25a35ec-95b7-43e9-b50e-7b0383b89df4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.194583] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25a35ec-95b7-43e9-b50e-7b0383b89df4',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.226311] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.226558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.226558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.227148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.227148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.227148] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be created. [ 852.253547] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.253696] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.253882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.253977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.254148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.255439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.255659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.255659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.255819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.255870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.256133] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.256229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.256313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.256420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.256491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.256574] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bade862-ff24-47f6-913c-4a011dd3df71 already deleted. [ 852.256651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.257438] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.257529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.257616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.257747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.257822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.257910] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba is going to be updated. [ 852.259336] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.259336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.259336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.259539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.259539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.259605] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 852.275245] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: UNINITIALIZED for 2s [ 852.292355] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.292474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.292541] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.292744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.292898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.295219] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.295348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.295416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.295604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.295738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.307571] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 852.308298] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: IN_PROGRESS for 2s [ 852.487406] env[66157]: INFO networking_nsxv3.common.synchronization [req-cccf7253-da16-4a9a-8f99-d4dfe2e53072 req-3d853824-38c5-4d8d-b9b2-32145c8013a6 tempest-ServerPasswordTestJSON-1157897379 tempest-ServerPasswordTestJSON-1157897379-project-member] Enqueued Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGHEST for action security_group_members [ 852.488517] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGHEST for action security_group_members [ 852.488517] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.488517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.488517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.488729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.489103] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.489243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.489302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.489471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.489558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.489653] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.697758] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.697961] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.698188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.698664] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.698664] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.698664] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port b25a35ec-95b7-43e9-b50e-7b0383b89df4 not found, creating... [ 852.699191] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.699191] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.699414] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.699501] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.699553] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.699847] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.700055] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.700177] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.700373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.700498] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.700631] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: b25a35ec-95b7-43e9-b50e-7b0383b89df4 is going to be created. [ 852.723746] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.724662] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.724662] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.724662] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.724662] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.724990] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-b25a35ec-95b7-43e9-b50e-7b0383b89df4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.823584] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 in Status: SUCCESS [ 852.823865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.994277] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.994277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.994277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.994277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.015356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.015689] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.015826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.015895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.016109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.016191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.016281] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 is going to be updated. [ 853.056784] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.056784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.056784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.056784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.056784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.072067] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 in Status: IN_PROGRESS for 2s [ 853.483107] env[66157]: INFO networking_nsxv3.common.synchronization [req-10a0eaec-8a62-4da0-8a51-65ffd3084aea req-75d06276-ea52-4855-a8a8-6a8bb0763efb service nova] Enqueued Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGHEST for action security_group_rules [ 853.483107] env[66157]: INFO networking_nsxv3.common.synchronization [req-10a0eaec-8a62-4da0-8a51-65ffd3084aea req-75d06276-ea52-4855-a8a8-6a8bb0763efb service nova] Enqueued Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGHEST for action security_group_members [ 853.483107] env[66157]: INFO networking_nsxv3.common.synchronization [req-10a0eaec-8a62-4da0-8a51-65ffd3084aea req-75d06276-ea52-4855-a8a8-6a8bb0763efb service nova] Enqueued Resource ID: b25a35ec-95b7-43e9-b50e-7b0383b89df4 with Priority: HIGHEST for action port [ 853.483637] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGHEST for action security_group_rules [ 853.483764] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGHEST for action security_group_members [ 853.483899] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b25a35ec-95b7-43e9-b50e-7b0383b89df4 with Priority: HIGHEST for action port [ 853.485417] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bade862-ff24-47f6-913c-4a011dd3df71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.487486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.487486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.487486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.487486] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.489222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bade862-ff24-47f6-913c-4a011dd3df71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.489222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.489222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.489222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.489222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.489222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.489222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.489222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.489222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.489222] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.492520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b25a35ec-95b7-43e9-b50e-7b0383b89df4 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.492613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b25a35ec-95b7-43e9-b50e-7b0383b89df4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.492686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b25a35ec-95b7-43e9-b50e-7b0383b89df4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.492860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b25a35ec-95b7-43e9-b50e-7b0383b89df4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.492930] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25a35ec-95b7-43e9-b50e-7b0383b89df4',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.996569] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bade862-ff24-47f6-913c-4a011dd3df71 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.996569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.996569] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b25a35ec-95b7-43e9-b50e-7b0383b89df4 with status ACTIVE [ 853.996569] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.996569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.996569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.996569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.996569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.997450] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.997450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.997450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.997771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.997771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.997895] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.997972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.998059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.998207] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.998276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.998386] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b25a35ec-95b7-43e9-b50e-7b0383b89df4 is going to be updated. [ 853.999517] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.022507] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.022848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.022929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.023165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.023305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.023469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b25a35ec-95b7-43e9-b50e-7b0383b89df4" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.312373] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: UNINITIALIZED for 4s [ 854.326935] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 854.327176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.328040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.328368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.328567] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.328707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.328813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.328979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.329082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.329174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.329346] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.329458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.330273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.330273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.330273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.330273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.330273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.330273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.330273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.330273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.330966] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.331980] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: SUCCESS [ 854.332175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.332344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.332510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.332665] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.332764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.332881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.332962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.333235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.333338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.333434] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.503125] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.835898] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4339fe92-f605-41dc-aba6-ccecae77b024: rpc.has_security_group_logging(os_id): False [ 854.837454] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.856443] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.856443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.856443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.856443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.876825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.877101] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.877324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.877324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.878144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.878144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.878144] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.878144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.878144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.878627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.882174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.882411] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.882519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.882584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.882747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.882828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.882918] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 854.950789] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.950961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.951029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.951256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.951410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.965737] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 855.012087] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.012087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.012087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.012087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.012087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.012087] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bade862-ff24-47f6-913c-4a011dd3df71 is going to be created. [ 855.069049] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.069241] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.069241] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.069390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.069529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.081321] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 in Status: SUCCESS [ 855.081512] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 deletion is rescheduled due to dependency. [ 855.081627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.082602] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bade862-ff24-47f6-913c-4a011dd3df71 in Status: UNINITIALIZED for 2s [ 855.339419] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 413d37d4-0b94-44d0-aa20-20a2f41994ba: rpc.has_security_group_logging(os_id): False [ 855.363768] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.363882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.363882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.364217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.364217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.364429] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.368139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.368305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.368439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.368527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.368629] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba is going to be updated. [ 855.453690] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.454083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.454083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.454335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.454430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.470367] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: IN_PROGRESS for 2s [ 855.917369] env[66157]: INFO networking_nsxv3.common.synchronization [None req-38411b86-5262-4377-8aeb-a898454e28c7 None None] Enqueued Resource ID: a58f9137-b6d3-4892-96b4-33b79672609e with Priority: HIGHEST for action port [ 855.917900] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58f9137-b6d3-4892-96b4-33b79672609e with Priority: HIGHEST for action port [ 855.918778] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a58f9137-b6d3-4892-96b4-33b79672609e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.918778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a58f9137-b6d3-4892-96b4-33b79672609e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.918778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a58f9137-b6d3-4892-96b4-33b79672609e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.918778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a58f9137-b6d3-4892-96b4-33b79672609e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.918778] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a58f9137-b6d3-4892-96b4-33b79672609e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.324127] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: SUCCESS [ 856.324465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.324530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.324757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.325198] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.325198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.325355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.325460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.325544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.325634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.325725] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.420554] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a58f9137-b6d3-4892-96b4-33b79672609e [ 856.420795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.421779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.421779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.421779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.421779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.421779] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a58f9137-b6d3-4892-96b4-33b79672609e already deleted. [ 856.421779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a58f9137-b6d3-4892-96b4-33b79672609e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.793457] env[66157]: INFO networking_nsxv3.common.synchronization [req-f25172c0-ae7c-4f09-9982-df4d8fffd60e req-f497f1a3-7fb5-467f-9421-d8058eff01f7 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_members [ 856.795032] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_members [ 856.795526] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.796515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.796631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.797009] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.798122] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.798321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.798381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.800367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.800367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.800367] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.828465] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.984471] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 856.984688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.984886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.985160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.985253] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.096399] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bade862-ff24-47f6-913c-4a011dd3df71 in Status: SUCCESS [ 857.096711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.096977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.097248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.097510] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.097641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.097711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.097885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.097969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.098074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.098176] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.302800] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.303119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.303119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.303275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.303367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.303713] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.303870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.303870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.304035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.304278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.304278] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 already deleted. [ 857.304278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.330530] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62b70f12-d63b-40fb-b48e-a611590fad1f: rpc.has_security_group_logging(os_id): False [ 857.352655] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.352655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.352927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.353279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.353279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.353397] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.353500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.353500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.353681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.353778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.353830] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be created. [ 857.387451] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-869 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.387654] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.387857] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.389110] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.393036] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.393036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.393036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.393036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.393036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.393036] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.393036] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.393036] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.393036] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.393036] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.393036] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.393036] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.418040] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.418040] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.418356] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.418645] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.419128] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-c6641750-0c27-4bb6-8e47-5053c2cd55a1 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.419437] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-c6641750-0c27-4bb6-8e47-5053c2cd55a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.419704] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-c6641750-0c27-4bb6-8e47-5053c2cd55a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.420180] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-c6641750-0c27-4bb6-8e47-5053c2cd55a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.420413] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6641750-0c27-4bb6-8e47-5053c2cd55a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.436027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.436308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.436308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.436473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.437141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.454155] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: IN_PROGRESS for 2s [ 857.488092] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.488266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.488340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.488572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.488744] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.488843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.488906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.489171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.489261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.489353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.489444] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.491269] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: SUCCESS [ 857.491464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.604724] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bade862-ff24-47f6-913c-4a011dd3df71 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.604925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.604970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.605247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.605431] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.605535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.605631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.605774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.605855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.605928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.606086] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bade862-ff24-47f6-913c-4a011dd3df71 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.606194] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.606256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.606399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.606558] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.606619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.606675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.606808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.606883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.606961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.607082] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.747452] env[66157]: INFO networking_nsxv3.common.synchronization [req-dfe41117-d874-4fff-84cd-ad8706ba8ec2 req-ff2d3b2e-aa0c-4f93-968c-f326e0bc4b84 tempest-ServersAdminTestJSON-1739826864 tempest-ServersAdminTestJSON-1739826864-project-member] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 857.748718] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 857.749638] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.749802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.749879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.750028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.750200] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.750301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.750363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.750533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.750644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.750741] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.924122] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.927027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.927027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.927027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.927027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.927027] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port c6641750-0c27-4bb6-8e47-5053c2cd55a1 not found, creating... [ 857.927027] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.927027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.927027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.927027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.927027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.927731] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.927731] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.927731] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.928121] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.928383] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.928735] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: c6641750-0c27-4bb6-8e47-5053c2cd55a1 is going to be created. [ 857.951196] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.952634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.952634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.952634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.952634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.952634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-c6641750-0c27-4bb6-8e47-5053c2cd55a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.993158] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.993583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.993583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.993688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.993809] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.993911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.993977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.994147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.994401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.994401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.994632] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.994632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.994632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.994918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.994918] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.995602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.995602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.995602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.995602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.995602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.995602] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.110452] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bade862-ff24-47f6-913c-4a011dd3df71: rpc.has_security_group_logging(os_id): False [ 858.130328] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.130593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.130593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.130798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.130852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.131052] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.131237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.131237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.131477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.131477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.131623] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.131710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.131766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.131905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.131978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.132319] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.132418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.132472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.132611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.132685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.132772] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bade862-ff24-47f6-913c-4a011dd3df71 is going to be created. [ 858.207283] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.207283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.207283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.207602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.207714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.222571] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bade862-ff24-47f6-913c-4a011dd3df71 in Status: IN_PROGRESS for 2s [ 858.255046] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.504313] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4339fe92-f605-41dc-aba6-ccecae77b024: rpc.has_security_group_logging(os_id): False [ 858.524907] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.524907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.524907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.525123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.525365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.525575] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.525575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.525683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.526070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.526070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.526261] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.526261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.526344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.526475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.526579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.526812] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.526953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.527129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.529609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.529609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.529609] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 858.594746] env[66157]: INFO networking_nsxv3.common.synchronization [None req-3bb04871-8416-48db-9140-ffd7809ee20f None None] Enqueued Resource ID: 4f173319-eb85-4fe9-bc6f-e5d1beb83959 with Priority: HIGHEST for action port [ 858.595369] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f173319-eb85-4fe9-bc6f-e5d1beb83959 with Priority: HIGHEST for action port [ 858.595727] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f173319-eb85-4fe9-bc6f-e5d1beb83959 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.595884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f173319-eb85-4fe9-bc6f-e5d1beb83959" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.596032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f173319-eb85-4fe9-bc6f-e5d1beb83959" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.596238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f173319-eb85-4fe9-bc6f-e5d1beb83959" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.596299] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f173319-eb85-4fe9-bc6f-e5d1beb83959',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.605930] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.606101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.606166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.606372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.606559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.622396] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 858.674760] env[66157]: INFO networking_nsxv3.common.synchronization [req-f25172c0-ae7c-4f09-9982-df4d8fffd60e req-87b0b8bf-0740-40b2-aa26-962a1d1a3774 service nova] Enqueued Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_rules [ 858.675024] env[66157]: INFO networking_nsxv3.common.synchronization [req-f25172c0-ae7c-4f09-9982-df4d8fffd60e req-87b0b8bf-0740-40b2-aa26-962a1d1a3774 service nova] Enqueued Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_members [ 858.675108] env[66157]: INFO networking_nsxv3.common.synchronization [req-f25172c0-ae7c-4f09-9982-df4d8fffd60e req-87b0b8bf-0740-40b2-aa26-962a1d1a3774 service nova] Enqueued Resource ID: c6641750-0c27-4bb6-8e47-5053c2cd55a1 with Priority: HIGHEST for action port [ 858.675605] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_rules [ 858.675743] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_members [ 858.675868] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6641750-0c27-4bb6-8e47-5053c2cd55a1 with Priority: HIGHEST for action port [ 858.676327] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.676456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.676536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.677727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.677727] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.680911] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.680911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.680911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.680911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.680911] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.680911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.680911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.680911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.680911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.680911] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.683244] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6641750-0c27-4bb6-8e47-5053c2cd55a1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.683244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6641750-0c27-4bb6-8e47-5053c2cd55a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.683244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6641750-0c27-4bb6-8e47-5053c2cd55a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.683244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6641750-0c27-4bb6-8e47-5053c2cd55a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.683244] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6641750-0c27-4bb6-8e47-5053c2cd55a1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.757605] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.100640] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f173319-eb85-4fe9-bc6f-e5d1beb83959 [ 859.100866] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.100996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.101090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.102491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.102618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.102729] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f173319-eb85-4fe9-bc6f-e5d1beb83959 already deleted. [ 859.102817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f173319-eb85-4fe9-bc6f-e5d1beb83959" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.187282] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.188293] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.188498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.189518] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6641750-0c27-4bb6-8e47-5053c2cd55a1 with status ACTIVE [ 859.189518] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.189518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.189518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.189518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.189891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.189891] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.189891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.189891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.190190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.190190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.190282] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.190367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.190430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.190572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.190638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.190713] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6641750-0c27-4bb6-8e47-5053c2cd55a1 is going to be updated. [ 859.214791] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.214791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.214791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.215077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.215077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.215235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6641750-0c27-4bb6-8e47-5053c2cd55a1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.261082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.261229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.261229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.261493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.261750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.261750] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 859.312996] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.313232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.313277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.313537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.313695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.324327] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 859.481155] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: SUCCESS [ 859.481524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.690110] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.193726] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.193900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.193900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.194155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.194250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.194344] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 is going to be created. [ 860.220238] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.220463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.220463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.220752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.220836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.238258] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 in Status: UNINITIALIZED for 2s [ 860.243030] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bade862-ff24-47f6-913c-4a011dd3df71 in Status: SUCCESS [ 860.243175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.641452] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 860.641657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.334875] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 861.335227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.252902] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 in Status: SUCCESS [ 862.253181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.253341] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.253562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.253756] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.253874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.253940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.254118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.254190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.254269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.254361] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.758260] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.881265] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f9b0d1ce-b154-4a36-b61e-481f6f4ddde6 None None] Enqueued Resource ID: 6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d with Priority: HIGHEST for action port [ 862.881814] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d with Priority: HIGHEST for action port [ 862.883163] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.883344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.883616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.883616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.883794] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.263452] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 646e01e7-0331-4a5c-9b1a-a3be54c1ee07: rpc.has_security_group_logging(os_id): False [ 863.284999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.286187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.291352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.291352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.291352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.291352] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.291352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.291352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.291352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.291352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.291352] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 is going to be created. [ 863.362705] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.362915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.363057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.363359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.363623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.376844] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 in Status: IN_PROGRESS for 2s [ 863.388677] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d [ 863.388990] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.389100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.389169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.389438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.389533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.389637] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d already deleted. [ 863.389732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ba1fdfd-9edc-4835-aadc-3dcbf9e14b4d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.183452] env[66157]: INFO networking_nsxv3.common.synchronization [req-ad766b5f-f5bc-4053-a76c-ba8ef50c0675 req-3e47f821-e507-4dbb-b65f-c48ffd66fe3b tempest-ServersNegativeTestMultiTenantJSON-1642336522 tempest-ServersNegativeTestMultiTenantJSON-1642336522-project-member] Enqueued Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGHEST for action security_group_members [ 864.184270] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGHEST for action security_group_members [ 864.184509] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.184635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.184701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.184952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.187131] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.187131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.187131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.187351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.187399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.187819] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.603074] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.603288] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-971" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.604462] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-971" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.604462] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-971" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.604462] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.604462] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.604462] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.604822] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.605099] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.606600] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.606600] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.606600] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.606600] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.606600] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.606600] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.606600] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.628953] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.629143] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.629302] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.629531] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-971" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.629806] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.629959] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.630137] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.630421] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.630791] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac25bdc2-3a07-4637-9e8a-f5f2121b27e5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.693170] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.693317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.693381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.693596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.693686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.693883] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.693987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.694048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.694193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.694268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.694353] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf already deleted. [ 864.694456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.889463] env[66157]: INFO networking_nsxv3.common.synchronization [req-830b3552-06c0-4cd5-8345-bc05050fa1ee req-5ebf0799-cfc6-45d7-9dce-6be5851134c7 tempest-ServerAddressesNegativeTestJSON-1723238863 tempest-ServerAddressesNegativeTestJSON-1723238863-project-member] Enqueued Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGHEST for action security_group_members [ 864.890072] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGHEST for action security_group_members [ 864.890817] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bade862-ff24-47f6-913c-4a011dd3df71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.890817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.890817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.891088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.891088] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.891088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.891264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.891303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.891378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.891467] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.133455] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.133779] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.133914] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.134368] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.134368] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.134518] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port ac25bdc2-3a07-4637-9e8a-f5f2121b27e5 not found, creating... [ 865.134836] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.134997] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.135130] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.135408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.135630] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.136554] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.136947] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.137492] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.137833] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.138087] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.138627] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: ac25bdc2-3a07-4637-9e8a-f5f2121b27e5 is going to be created. [ 865.162019] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.162019] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.162019] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.162344] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.162523] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.162822] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.273378] env[66157]: INFO networking_nsxv3.common.synchronization [None req-d8969810-1c76-4a34-a194-a53432564b92 None None] Enqueued Resource ID: 68330ef2-1db3-4527-b9bc-4adcc01878dd with Priority: HIGHEST for action port [ 865.273378] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68330ef2-1db3-4527-b9bc-4adcc01878dd with Priority: HIGHEST for action port [ 865.273378] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-68330ef2-1db3-4527-b9bc-4adcc01878dd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.273378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68330ef2-1db3-4527-b9bc-4adcc01878dd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.273378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68330ef2-1db3-4527-b9bc-4adcc01878dd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.273378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68330ef2-1db3-4527-b9bc-4adcc01878dd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.273378] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68330ef2-1db3-4527-b9bc-4adcc01878dd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.390664] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 in Status: SUCCESS [ 865.391086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.393718] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.393868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.394069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.394294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.394428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.394674] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.394784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.394853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.395187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.395279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.395419] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bade862-ff24-47f6-913c-4a011dd3df71 is going to be updated. [ 865.424643] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.425528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.425528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.425528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.425528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.436961] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bade862-ff24-47f6-913c-4a011dd3df71 in Status: IN_PROGRESS for 2s [ 865.775523] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68330ef2-1db3-4527-b9bc-4adcc01878dd [ 865.775523] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.775523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.775523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.775910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.775910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.775910] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68330ef2-1db3-4527-b9bc-4adcc01878dd already deleted. [ 865.776085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68330ef2-1db3-4527-b9bc-4adcc01878dd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.907836] env[66157]: INFO networking_nsxv3.common.synchronization [req-ad766b5f-f5bc-4053-a76c-ba8ef50c0675 req-268312dd-94df-400d-98c1-68f170ac342f service nova] Enqueued Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGHEST for action security_group_rules [ 865.907836] env[66157]: INFO networking_nsxv3.common.synchronization [req-ad766b5f-f5bc-4053-a76c-ba8ef50c0675 req-268312dd-94df-400d-98c1-68f170ac342f service nova] Enqueued Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGHEST for action security_group_members [ 865.907836] env[66157]: INFO networking_nsxv3.common.synchronization [req-ad766b5f-f5bc-4053-a76c-ba8ef50c0675 req-268312dd-94df-400d-98c1-68f170ac342f service nova] Enqueued Resource ID: ac25bdc2-3a07-4637-9e8a-f5f2121b27e5 with Priority: HIGHEST for action port [ 865.908196] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGHEST for action security_group_rules [ 865.908332] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGHEST for action security_group_members [ 865.908429] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac25bdc2-3a07-4637-9e8a-f5f2121b27e5 with Priority: HIGHEST for action port [ 865.908706] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.908828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.908895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.909470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.909839] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.911345] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.911607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.911607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.911764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.912313] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.912503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.912574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.912735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.912824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.912922] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.914272] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.914463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.914526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.914688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.914759] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac25bdc2-3a07-4637-9e8a-f5f2121b27e5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.412291] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.412680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.414851] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.416767] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac25bdc2-3a07-4637-9e8a-f5f2121b27e5 with status ACTIVE [ 866.416767] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.416767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.416912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.417233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.417233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.417448] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.417619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.417846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.417988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.418132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.418426] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.418577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.418673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.418928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.419010] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.419197] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac25bdc2-3a07-4637-9e8a-f5f2121b27e5 is going to be updated. [ 866.443506] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.444259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.444259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.444259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.444259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.444259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac25bdc2-3a07-4637-9e8a-f5f2121b27e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.917378] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.421518] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.421870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.421870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.422095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.422223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.422349] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf is going to be created. [ 867.448791] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.449037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.449123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.449336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.449596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.451327] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bade862-ff24-47f6-913c-4a011dd3df71 in Status: SUCCESS [ 867.451506] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bade862-ff24-47f6-913c-4a011dd3df71 deletion is rescheduled due to dependency. [ 867.451628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.459540] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf in Status: UNINITIALIZED for 2s [ 869.481146] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf in Status: SUCCESS [ 869.481456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.481577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.481814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.482028] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.482159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.482222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.482388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.482470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.482555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.482644] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.987273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.987548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.987548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.988055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.988055] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.988202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.988291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.988473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.988596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.988718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.988925] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.989056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.990138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.990138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.990138] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.990138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.990138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.990370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.990370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.990437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.991428] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.494333] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a68cfe0b-467e-482c-b4ec-3f99b4e37ecf: rpc.has_security_group_logging(os_id): False [ 870.516044] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.516044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.516044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.516308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.516401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.516572] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.516747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.516747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.516865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.516985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.517136] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.517313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.517313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.517472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.517472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.517735] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.517875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.517875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.518025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.518107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.518198] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf is going to be created. [ 870.584559] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.584784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.584784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.585124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.585317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.602307] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf in Status: IN_PROGRESS for 2s [ 870.910012] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 870.910155] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 872.618534] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf in Status: SUCCESS [ 872.619193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.862096] env[66157]: INFO networking_nsxv3.common.synchronization [None req-230cdf44-79a2-44fc-9f36-14f5447d64c2 None None] Enqueued Resource ID: e78fb4cb-c380-4729-9d1d-71f915fc8271 with Priority: HIGHEST for action port [ 873.862749] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78fb4cb-c380-4729-9d1d-71f915fc8271 with Priority: HIGHEST for action port [ 873.863091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e78fb4cb-c380-4729-9d1d-71f915fc8271 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.863211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e78fb4cb-c380-4729-9d1d-71f915fc8271" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.863273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e78fb4cb-c380-4729-9d1d-71f915fc8271" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.863529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e78fb4cb-c380-4729-9d1d-71f915fc8271" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.863610] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e78fb4cb-c380-4729-9d1d-71f915fc8271',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.365873] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e78fb4cb-c380-4729-9d1d-71f915fc8271 [ 874.366154] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.366282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.366347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.366547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.367415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.367415] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e78fb4cb-c380-4729-9d1d-71f915fc8271 already deleted. [ 874.367415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e78fb4cb-c380-4729-9d1d-71f915fc8271" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.105595] env[66157]: INFO networking_nsxv3.common.synchronization [None req-fba3e184-408b-4bba-9ee5-dff5d2b1b31e None None] Enqueued Resource ID: 59d08644-dbf2-4e40-8f24-81a4e6bb91e0 with Priority: HIGHEST for action port [ 876.105595] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59d08644-dbf2-4e40-8f24-81a4e6bb91e0 with Priority: HIGHEST for action port [ 876.106047] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-59d08644-dbf2-4e40-8f24-81a4e6bb91e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.106047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59d08644-dbf2-4e40-8f24-81a4e6bb91e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.106047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59d08644-dbf2-4e40-8f24-81a4e6bb91e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.106202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59d08644-dbf2-4e40-8f24-81a4e6bb91e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.106245] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d08644-dbf2-4e40-8f24-81a4e6bb91e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.609220] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59d08644-dbf2-4e40-8f24-81a4e6bb91e0 [ 876.609502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.609617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.609690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.609926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.610036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.610142] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59d08644-dbf2-4e40-8f24-81a4e6bb91e0 already deleted. [ 876.610227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59d08644-dbf2-4e40-8f24-81a4e6bb91e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.179498] env[66157]: INFO networking_nsxv3.common.synchronization [req-78d3099b-a1d6-4974-ab39-90510dd97984 req-367e8052-67f5-43dc-a94e-e3b464b55d09 tempest-ServersAdminNegativeTestJSON-2016589142 tempest-ServersAdminNegativeTestJSON-2016589142-project-member] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 877.181409] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGHEST for action security_group_members [ 877.181409] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.181409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.181409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.181709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.181709] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.181709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.181885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.182019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.182078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.182338] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.684787] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.685386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.685386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.685386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.685386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.685517] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.685580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.685639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.685786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.685857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.685959] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be updated. [ 877.719027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.719027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.719027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.719245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.719399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.729568] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: IN_PROGRESS for 2s [ 878.082086] env[66157]: INFO networking_nsxv3.common.synchronization [req-651a825b-b7a6-4eee-ac43-ad3a285391ef req-ece3e4dd-a332-4927-adae-84d960afd9af tempest-ServersNegativeTestMultiTenantJSON-1642336522 tempest-ServersNegativeTestMultiTenantJSON-1642336522-project-member] Enqueued Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGHEST for action security_group_members [ 878.082762] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGHEST for action security_group_members [ 878.082939] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.083134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.083206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.083403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.083668] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.083668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.083785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.083842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.083922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.084026] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.586278] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.586600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.586640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.586878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.587015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.587257] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.587392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.587467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.587654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.587749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.587899] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf is going to be updated. [ 878.622465] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.623012] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.623225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.623548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.623883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.635657] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf in Status: IN_PROGRESS for 2s [ 879.740746] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 in Status: SUCCESS [ 879.741543] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 deletion is rescheduled due to dependency. [ 879.741543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.646244] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf in Status: SUCCESS [ 880.646434] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf deletion is rescheduled due to dependency. [ 880.646546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.126317] env[66157]: INFO networking_nsxv3.common.synchronization [req-9a1cc492-7fc0-4789-80cc-d08de2c6560f req-fc1d8a6e-fa90-4bfe-908c-0b2a27bc5d3d tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 882.128782] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 882.129127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.129243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.129326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.129565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.129719] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.129809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.129870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.130145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.130246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.130296] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.465435] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.465639] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.465758] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.466101] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.466397] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.466597] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.466725] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.466943] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.467440] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.467669] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.467873] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.468088] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.468209] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.468322] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.468424] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.468550] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.488801] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.488972] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.489125] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.489302] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.489616] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-8e719f04-127c-4d1f-a256-b60ab500e821 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.490477] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-8e719f04-127c-4d1f-a256-b60ab500e821" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.490477] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-8e719f04-127c-4d1f-a256-b60ab500e821" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.490477] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-8e719f04-127c-4d1f-a256-b60ab500e821" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.490477] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e719f04-127c-4d1f-a256-b60ab500e821',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.632178] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.632351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.632426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.632650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.632742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.632945] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.633059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.633145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.633304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.633380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.633466] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 already deleted. [ 882.633536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.993431] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.993663] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.993880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.994308] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.994560] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.994830] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 8e719f04-127c-4d1f-a256-b60ab500e821 not found, creating... [ 882.995192] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.995363] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.995479] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.995728] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.996123] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.996197] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.996352] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.996468] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.996682] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.996845] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.996971] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 8e719f04-127c-4d1f-a256-b60ab500e821 is going to be created. [ 883.024109] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.024343] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.024479] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.024795] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.025547] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.025547] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-8e719f04-127c-4d1f-a256-b60ab500e821" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.761274] env[66157]: INFO networking_nsxv3.common.synchronization [req-9a1cc492-7fc0-4789-80cc-d08de2c6560f req-4d01bcbd-822a-4a02-95d4-7e20d858b616 service nova] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_rules [ 883.761563] env[66157]: INFO networking_nsxv3.common.synchronization [req-9a1cc492-7fc0-4789-80cc-d08de2c6560f req-4d01bcbd-822a-4a02-95d4-7e20d858b616 service nova] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 883.761611] env[66157]: INFO networking_nsxv3.common.synchronization [req-9a1cc492-7fc0-4789-80cc-d08de2c6560f req-4d01bcbd-822a-4a02-95d4-7e20d858b616 service nova] Enqueued Resource ID: 8e719f04-127c-4d1f-a256-b60ab500e821 with Priority: HIGHEST for action port [ 883.762122] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_rules [ 883.762264] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 883.762385] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e719f04-127c-4d1f-a256-b60ab500e821 with Priority: HIGHEST for action port [ 883.762674] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.762798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.762867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.763077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.763165] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.764015] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.764123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.764193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.764362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.764504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.764643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.764677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.764791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.764879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.766068] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.766068] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e719f04-127c-4d1f-a256-b60ab500e821 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.766068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e719f04-127c-4d1f-a256-b60ab500e821" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.766068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e719f04-127c-4d1f-a256-b60ab500e821" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.766068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e719f04-127c-4d1f-a256-b60ab500e821" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.766654] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e719f04-127c-4d1f-a256-b60ab500e821',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.267641] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.267886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.268165] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e719f04-127c-4d1f-a256-b60ab500e821 with status ACTIVE [ 884.268425] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.268613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.268711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.269020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.269293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.271143] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.271143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.271143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.271143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.271143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.271143] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.271143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.271143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.271143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.271143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.271143] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e719f04-127c-4d1f-a256-b60ab500e821 is going to be updated. [ 884.272110] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.293675] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.293847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.293897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.294108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.294242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.294408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e719f04-127c-4d1f-a256-b60ab500e821" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.774973] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.868033] env[66157]: INFO networking_nsxv3.common.synchronization [req-eef5ce88-cb99-4a2c-918b-9e442e7c2e65 req-2a14cf1a-097f-47ef-8d36-f487f352fe29 tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 884.868163] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 884.868379] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.868496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.868595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.868790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.868942] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.869053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.869688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.869688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.869688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.869688] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.192642] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.192879] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.193028] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.193330] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.193640] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.193831] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.193955] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.194241] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.194438] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.194653] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.194764] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.194870] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.194973] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.195089] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.195192] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.195313] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.218659] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.218859] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.218971] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.219218] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.219483] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-e70206f0-fa07-4a7c-8adb-8819a11d2c89 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.219653] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-e70206f0-fa07-4a7c-8adb-8819a11d2c89" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.219768] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-e70206f0-fa07-4a7c-8adb-8819a11d2c89" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.220153] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-e70206f0-fa07-4a7c-8adb-8819a11d2c89" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.220402] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e70206f0-fa07-4a7c-8adb-8819a11d2c89',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.278037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.278037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.278037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.278298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.278298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.278375] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 is going to be created. [ 885.302993] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.303152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.303228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.303446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.303603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.313925] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: UNINITIALIZED for 2s [ 885.371791] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.725351] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.725494] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.725633] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.726300] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.726300] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.726300] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port e70206f0-fa07-4a7c-8adb-8819a11d2c89 not found, creating... [ 885.726539] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.726709] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.726836] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.727079] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.727227] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.727526] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.727680] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.727802] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.728046] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.728211] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.728520] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: e70206f0-fa07-4a7c-8adb-8819a11d2c89 is going to be created. [ 885.749181] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.749422] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.749561] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.749858] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.750146] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.750376] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-e70206f0-fa07-4a7c-8adb-8819a11d2c89" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.876384] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.379848] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.380053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.380221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.380451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.380532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.380699] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 886.409140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.409140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.409140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.409367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.409450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.418744] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 886.471853] env[66157]: INFO networking_nsxv3.common.synchronization [req-eef5ce88-cb99-4a2c-918b-9e442e7c2e65 req-47cef6eb-2dc9-4ba6-8b02-c6bf97b72974 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 886.472073] env[66157]: INFO networking_nsxv3.common.synchronization [req-eef5ce88-cb99-4a2c-918b-9e442e7c2e65 req-47cef6eb-2dc9-4ba6-8b02-c6bf97b72974 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 886.472572] env[66157]: INFO networking_nsxv3.common.synchronization [req-eef5ce88-cb99-4a2c-918b-9e442e7c2e65 req-47cef6eb-2dc9-4ba6-8b02-c6bf97b72974 service nova] Enqueued Resource ID: e70206f0-fa07-4a7c-8adb-8819a11d2c89 with Priority: HIGHEST for action port [ 886.472752] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 886.472878] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 886.472948] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70206f0-fa07-4a7c-8adb-8819a11d2c89 with Priority: HIGHEST for action port [ 886.473219] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.473417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.473417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.473663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.473663] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.474495] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.475839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.475839] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e70206f0-fa07-4a7c-8adb-8819a11d2c89 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.475839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e70206f0-fa07-4a7c-8adb-8819a11d2c89" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.475839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e70206f0-fa07-4a7c-8adb-8819a11d2c89" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.475839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e70206f0-fa07-4a7c-8adb-8819a11d2c89" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.475839] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e70206f0-fa07-4a7c-8adb-8819a11d2c89',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.980018] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.980320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.980502] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e70206f0-fa07-4a7c-8adb-8819a11d2c89 with status ACTIVE [ 886.980702] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.980832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.980938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.981552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.981552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.981552] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.981552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.983467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.983467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.983467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.983467] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.983467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.983467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.983467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.983467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.983467] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e70206f0-fa07-4a7c-8adb-8819a11d2c89 is going to be updated. [ 887.010984] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.011179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.011292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.011491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.011632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.011798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e70206f0-fa07-4a7c-8adb-8819a11d2c89" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.329954] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: SUCCESS [ 887.331090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.331332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.331580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.331787] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.333374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.333374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.333374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.333374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.333374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.333374] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.835821] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.338427] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d46b1e4e-446b-4001-9e14-1ab5b40a8087: rpc.has_security_group_logging(os_id): False [ 888.356827] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.356996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.357084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.357326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.357421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.357671] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.357790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.357822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.357974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.358057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.358150] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 is going to be created. [ 888.437226] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 888.437515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.437747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.438067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.438382] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.438565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.438638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.438828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.438952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.439169] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.443090] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.443562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.443620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.443797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.443980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.456050] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: IN_PROGRESS for 2s [ 888.942838] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.445669] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.947408] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.947590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.947719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.947910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.948619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.948619] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 889.982111] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.982309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.982309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.983085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.983085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.992493] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 890.468310] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: SUCCESS [ 890.468678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.474613] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 891.474613] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 892.003781] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 892.005015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.005787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.006041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.006246] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.006362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.006435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.006627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.006723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.006802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.006899] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.511980] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.512387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.512387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.512458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.513037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.513037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.513037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.513037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.513204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.513204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.513302] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.513401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.513464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.513601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.513783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.513916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.513977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.514136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.514214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.514294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.514387] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.016910] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 893.045642] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.045642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.045642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.045642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.045642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.045642] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.046184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.046184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.046309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.046563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.046868] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.047185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.047328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.047608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.047754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.048081] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.048491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.048728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.049080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.049166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.049316] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 893.253130] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.253588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.253588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.253588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.253762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.281787] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 893.477962] env[66157]: INFO networking_nsxv3.common.synchronization [req-6ec11f0e-b237-4e56-aa0f-73e6459e4b0d req-210d9c79-4d83-42e8-92e3-89b9bf87bcdc tempest-InstanceActionsV221TestJSON-568421547 tempest-InstanceActionsV221TestJSON-568421547-project-member] Enqueued Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGHEST for action security_group_members [ 893.478767] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGHEST for action security_group_members [ 893.479256] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da99f927-2e97-469c-9968-08c9ce21543a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.479425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.479510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.479737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.479904] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.480011] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.480086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.480224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.480303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.480405] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.871606] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-919 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.871956] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-919" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.872017] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-919" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.872309] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-919" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.872578] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.872735] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.872871] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.873559] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.873740] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.873972] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.874116] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.874243] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.874348] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.874461] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.874567] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.874719] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.893740] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.893926] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.894066] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.894343] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-919" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.894709] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-2760b45c-d406-4ab8-9bec-a006376db8ca taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.894932] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-2760b45c-d406-4ab8-9bec-a006376db8ca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.895093] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-2760b45c-d406-4ab8-9bec-a006376db8ca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.895428] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-2760b45c-d406-4ab8-9bec-a006376db8ca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.895610] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2760b45c-d406-4ab8-9bec-a006376db8ca',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.983996] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.984190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.984236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.984437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.984577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.984727] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.984827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.984891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.985057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.985134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.985217] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da99f927-2e97-469c-9968-08c9ce21543a already deleted. [ 893.985297] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.398385] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.398715] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.398851] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.399198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.399313] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.399469] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 2760b45c-d406-4ab8-9bec-a006376db8ca not found, creating... [ 894.399795] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.399962] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.400108] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.400333] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.400515] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.400817] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.400992] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.401121] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.401352] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.401510] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.401673] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 2760b45c-d406-4ab8-9bec-a006376db8ca is going to be created. [ 894.442359] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.442852] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.443038] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.443318] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.443635] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.444242] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-2760b45c-d406-4ab8-9bec-a006376db8ca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.199866] env[66157]: INFO networking_nsxv3.common.synchronization [req-6ec11f0e-b237-4e56-aa0f-73e6459e4b0d req-966080c5-08c5-4dd1-a774-505439d8e28c service nova] Enqueued Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGHEST for action security_group_rules [ 895.200134] env[66157]: INFO networking_nsxv3.common.synchronization [req-6ec11f0e-b237-4e56-aa0f-73e6459e4b0d req-966080c5-08c5-4dd1-a774-505439d8e28c service nova] Enqueued Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGHEST for action security_group_members [ 895.200279] env[66157]: INFO networking_nsxv3.common.synchronization [req-6ec11f0e-b237-4e56-aa0f-73e6459e4b0d req-966080c5-08c5-4dd1-a774-505439d8e28c service nova] Enqueued Resource ID: 2760b45c-d406-4ab8-9bec-a006376db8ca with Priority: HIGHEST for action port [ 895.201084] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGHEST for action security_group_rules [ 895.201229] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGHEST for action security_group_members [ 895.201358] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2760b45c-d406-4ab8-9bec-a006376db8ca with Priority: HIGHEST for action port [ 895.201710] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da99f927-2e97-469c-9968-08c9ce21543a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.201844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.201897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.202176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.202264] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.203651] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da99f927-2e97-469c-9968-08c9ce21543a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.204200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.204200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.204200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.204200] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.204406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.204406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.204488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.204530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.204601] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.205844] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2760b45c-d406-4ab8-9bec-a006376db8ca taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.205844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2760b45c-d406-4ab8-9bec-a006376db8ca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.205997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2760b45c-d406-4ab8-9bec-a006376db8ca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.206122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2760b45c-d406-4ab8-9bec-a006376db8ca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.206122] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2760b45c-d406-4ab8-9bec-a006376db8ca',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.295203] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 895.295429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.704735] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da99f927-2e97-469c-9968-08c9ce21543a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.704901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.709242] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2760b45c-d406-4ab8-9bec-a006376db8ca with status ACTIVE [ 895.709434] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.709553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.709623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.709835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.709980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.710108] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.710203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.710283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.710462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.710500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.710680] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.710774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.710834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.710973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.711098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.711136] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2760b45c-d406-4ab8-9bec-a006376db8ca is going to be updated. [ 895.712294] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.732850] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.733049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.733156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.733355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.733495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.733656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2760b45c-d406-4ab8-9bec-a006376db8ca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.214697] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.719407] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.719613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.719663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.719864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.719953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.720068] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da99f927-2e97-469c-9968-08c9ce21543a is going to be created. [ 896.746015] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.746015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.746347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.746347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.746449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.756648] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da99f927-2e97-469c-9968-08c9ce21543a in Status: UNINITIALIZED for 2s [ 898.020346] env[66157]: INFO networking_nsxv3.common.synchronization [req-e9a5bf08-1841-4d33-b6f3-b5931bb1e237 req-5fd613ba-bfab-4f8b-a9f0-3416e9098e04 tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 898.021321] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 898.021321] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.021467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.021467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.022529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.022529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.022529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.022529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.022529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.022529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.022529] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.025208] env[66157]: INFO networking_nsxv3.common.synchronization [req-a1a0e8a1-38a9-4f13-a471-c47e38d972f0 req-b0c33e79-91e7-404d-b02b-15e19227d72a tempest-ServersTestJSON-688042915 tempest-ServersTestJSON-688042915-project-member] Enqueued Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_members [ 898.026098] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGHEST for action security_group_members [ 898.026098] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93b3d3-7a24-441f-88d0-38d5293ec145 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.026258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.026258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.026391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.026641] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.026641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.026723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.026811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.026895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.026978] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.456321] env[66157]: INFO networking_nsxv3.common.synchronization [req-22bb24eb-13a4-4d0f-9fc3-aea46ea7c5be req-4bfe3e90-6294-4a32-8bee-70d7f0e47e68 tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 898.457336] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 898.457714] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.457834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.457900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.458127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.458269] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.458363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.458421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.458576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.458653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.458742] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.526609] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.531890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.531890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.531890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.531890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.531890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.531890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.531890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.531890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.531890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.531890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.531890] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 is going to be updated. [ 898.562396] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.562572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.562700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.566258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.566578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.586946] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 in Status: IN_PROGRESS for 2s [ 898.768020] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da99f927-2e97-469c-9968-08c9ce21543a in Status: SUCCESS [ 898.768258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.768435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.768739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.769229] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.769526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.769526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.769684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.769684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.770011] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.770011] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.874335] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.874590] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.874780] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.875228] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.875535] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.875723] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.875868] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.876158] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.876329] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.876565] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.876716] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.876839] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.876991] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.877142] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.877259] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.877417] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.897155] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.897377] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.897539] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.897769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.898159] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-22489376-8c58-4b2c-9fe2-f5810618d3ec taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.898372] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-22489376-8c58-4b2c-9fe2-f5810618d3ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.898527] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-22489376-8c58-4b2c-9fe2-f5810618d3ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.898901] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-22489376-8c58-4b2c-9fe2-f5810618d3ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.899078] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22489376-8c58-4b2c-9fe2-f5810618d3ec',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.963361] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.963533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.963618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.963851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.963963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.964177] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.964282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.964331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.964490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.964564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.964652] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be deleted. [ 898.995898] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.996107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.996167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.996372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.996526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.996612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.031272] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.272132] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da99f927-2e97-469c-9968-08c9ce21543a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.272528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.272608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.272785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.272955] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.273163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.273227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.273384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.273473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.273563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.273897] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da99f927-2e97-469c-9968-08c9ce21543a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.273897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.273897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.274106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.274132] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.274221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.274323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.274405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.274481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.274556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.274643] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.402706] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.402944] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.403191] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.403635] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.403850] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.404025] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 22489376-8c58-4b2c-9fe2-f5810618d3ec not found, creating... [ 899.404329] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.404497] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.404611] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.404889] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.405112] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.405403] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.405559] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.405670] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.405881] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.406017] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.406154] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 22489376-8c58-4b2c-9fe2-f5810618d3ec is going to be created. [ 899.429967] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.430209] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.430333] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.430613] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.430895] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.431148] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-22489376-8c58-4b2c-9fe2-f5810618d3ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.534451] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.534517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.534543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.534748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.534836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.534936] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 899.586905] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.587111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.587152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.587350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.587500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.597089] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 899.776727] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da99f927-2e97-469c-9968-08c9ce21543a: rpc.has_security_group_logging(os_id): False [ 899.801020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.801020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.801020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.801020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.801593] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.801593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.801593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.801593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.801593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.801593] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da99f927-2e97-469c-9968-08c9ce21543a is going to be created. [ 899.876653] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.876840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.876896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.877201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.877416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.889803] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da99f927-2e97-469c-9968-08c9ce21543a in Status: IN_PROGRESS for 2s [ 899.896981] env[66157]: INFO networking_nsxv3.common.synchronization [None req-fe2498b8-6758-46f0-a354-38925ccce41f tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_rules [ 899.898087] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_rules [ 899.898521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bb5a370-76e0-4d7c-9a46-84239200c704 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.898521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.898521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.898785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.898836] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.019393] env[66157]: INFO networking_nsxv3.common.synchronization [None req-bab9b4d0-82ad-4c4b-b32b-9ff954138d47 tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_rules [ 900.019934] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_rules [ 900.020302] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bb5a370-76e0-4d7c-9a46-84239200c704 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.020411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.189718] env[66157]: INFO networking_nsxv3.common.synchronization [req-22bb24eb-13a4-4d0f-9fc3-aea46ea7c5be req-db22433d-b93e-4b70-8432-c6351997b250 service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 900.189997] env[66157]: INFO networking_nsxv3.common.synchronization [req-22bb24eb-13a4-4d0f-9fc3-aea46ea7c5be req-db22433d-b93e-4b70-8432-c6351997b250 service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 900.190086] env[66157]: INFO networking_nsxv3.common.synchronization [req-22bb24eb-13a4-4d0f-9fc3-aea46ea7c5be req-db22433d-b93e-4b70-8432-c6351997b250 service nova] Enqueued Resource ID: 22489376-8c58-4b2c-9fe2-f5810618d3ec with Priority: HIGHEST for action port [ 900.190592] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 900.190821] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 900.191015] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22489376-8c58-4b2c-9fe2-f5810618d3ec with Priority: HIGHEST for action port [ 900.191391] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.191770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.191770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.191925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.192011] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.192968] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.193106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.193173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.193405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.193574] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.193672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.193732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.194168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.194307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.194412] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.195267] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-22489376-8c58-4b2c-9fe2-f5810618d3ec taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.195349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22489376-8c58-4b2c-9fe2-f5810618d3ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.195381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22489376-8c58-4b2c-9fe2-f5810618d3ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.195552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22489376-8c58-4b2c-9fe2-f5810618d3ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.195650] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22489376-8c58-4b2c-9fe2-f5810618d3ec',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.421565] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.421829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.422302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.422847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.422964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.423101] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 already deleted. [ 900.423158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.423325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.423577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.423666] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.597926] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 in Status: SUCCESS [ 900.598385] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 deletion is rescheduled due to dependency. [ 900.598555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.697992] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.698370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.698370] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.699329] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22489376-8c58-4b2c-9fe2-f5810618d3ec with status ACTIVE [ 900.699488] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.700208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.700208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.700208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.700208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.700208] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.700208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.700438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.700438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.700487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.700660] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.700763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.700883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.701027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.701097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.701121] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22489376-8c58-4b2c-9fe2-f5810618d3ec is going to be updated. [ 900.727404] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.727404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.727404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.727750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.727840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.728077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22489376-8c58-4b2c-9fe2-f5810618d3ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.945819] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.945961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.946050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.946267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.946353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.946444] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 already deleted. [ 900.946523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.203224] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.607206] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 901.607505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.707718] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.707718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.707718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.707718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.707718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.707718] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be created. [ 901.737493] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.737493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.737924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.737924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.738130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.749585] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: UNINITIALIZED for 2s [ 901.904991] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da99f927-2e97-469c-9968-08c9ce21543a in Status: SUCCESS [ 901.905155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.307790] env[66157]: INFO networking_nsxv3.common.synchronization [req-dfae0e3a-e44f-4709-882a-6997c38eba7a req-0273b8f4-66dd-4219-8835-04cadc1b96e3 tempest-ServersAdminTestJSON-1739826864 tempest-ServersAdminTestJSON-1739826864-project-member] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 903.308132] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 903.308258] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.308909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.308909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.308909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.309067] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.309067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.309180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.309240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.309327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.309442] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.759304] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 903.759499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.759645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.759872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.760081] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.760198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.760262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.760409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.760489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.760572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.760663] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.813034] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.262909] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.263067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.263067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.263381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.263575] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.263687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.263762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.263912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.263999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.264105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.264250] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.264340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.264398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.264535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.264671] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.264761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.264822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.264964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.265061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.265143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.265230] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.314820] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.767108] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4915dbf-d6e2-46dd-8508-11f50b8da0ef: rpc.has_security_group_logging(os_id): False [ 904.786251] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.786251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.786251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.786444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.786525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.786748] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.786850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.786912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.787106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.787158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.787342] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.787436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.787495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.787632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.787703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.787881] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.787973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.788058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.788202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.788275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.788370] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be created. [ 904.817384] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.818575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.818671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.818894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.818990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.819112] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 904.846195] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.846466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.846466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.846626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.848110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.853270] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.853401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.853468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.853667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.853807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.863984] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 904.865903] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 906.077021] env[66157]: INFO networking_nsxv3.common.synchronization [req-a3f7c4dc-c910-4a63-a44b-079eaff8ecbf req-96e882c5-22d6-4fee-a21b-f9775f61072d tempest-InstanceActionsV221TestJSON-568421547 tempest-InstanceActionsV221TestJSON-568421547-project-member] Enqueued Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGHEST for action security_group_members [ 906.077670] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGHEST for action security_group_members [ 906.077997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-da99f927-2e97-469c-9968-08c9ce21543a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.078137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.078202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.078406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.078680] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.078680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.078921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.078921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.078921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.079044] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.582497] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.582693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.582742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.582987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.583111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.583322] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.583426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.583493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.583672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.583750] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.583848] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da99f927-2e97-469c-9968-08c9ce21543a is going to be updated. [ 906.613904] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.614103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.614190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.614387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.614553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.623196] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da99f927-2e97-469c-9968-08c9ce21543a in Status: IN_PROGRESS for 2s [ 906.876542] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 906.876887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.890099] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 906.890372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.634853] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da99f927-2e97-469c-9968-08c9ce21543a in Status: SUCCESS [ 908.634853] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da99f927-2e97-469c-9968-08c9ce21543a deletion is rescheduled due to dependency. [ 908.634853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.913026] env[66157]: INFO networking_nsxv3.common.synchronization [req-864bcb8a-a518-496c-aebf-9a484ecc9357 req-c4854b2a-968d-4ff6-9537-2736f8e1b69b tempest-ServerRescueNegativeTestJSON-2006998581 tempest-ServerRescueNegativeTestJSON-2006998581-project-member] Enqueued Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_members [ 910.913512] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_members [ 910.913877] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-099cf4d4-ded3-44df-b6e7-328bc3763be6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.914020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.914098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.914383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.914557] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.914666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.914746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.914903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.914988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.915108] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.269108] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.269514] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.270020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.270187] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.270548] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.271766] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.271766] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.271766] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.271766] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.271766] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.271766] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.272048] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.272048] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.272048] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.272231] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.272231] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.293306] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.293489] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.293627] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.293799] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-992" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.294127] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-240839ac-a949-4da3-be33-c0393268a164 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.294301] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-240839ac-a949-4da3-be33-c0393268a164" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.294421] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-240839ac-a949-4da3-be33-c0393268a164" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.294732] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-240839ac-a949-4da3-be33-c0393268a164" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.294872] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240839ac-a949-4da3-be33-c0393268a164',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.418792] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.418957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.419068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.419474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.419580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.419801] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.419912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.419978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.420169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.420250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.420338] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 already deleted. [ 911.420418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.797719] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.797827] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.797970] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.798264] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.798467] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.798647] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 240839ac-a949-4da3-be33-c0393268a164 not found, creating... [ 911.798904] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.799089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.799224] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.799506] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.799687] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.799926] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.800089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.800203] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.800402] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.800582] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.800674] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 240839ac-a949-4da3-be33-c0393268a164 is going to be created. [ 911.821818] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.822036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.822176] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.822474] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.822702] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.822925] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-240839ac-a949-4da3-be33-c0393268a164" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.542564] env[66157]: INFO networking_nsxv3.common.synchronization [req-864bcb8a-a518-496c-aebf-9a484ecc9357 req-59df1d81-d455-406f-8f2c-98b77e0d38ad service nova] Enqueued Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_rules [ 912.542814] env[66157]: INFO networking_nsxv3.common.synchronization [req-864bcb8a-a518-496c-aebf-9a484ecc9357 req-59df1d81-d455-406f-8f2c-98b77e0d38ad service nova] Enqueued Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_members [ 912.542902] env[66157]: INFO networking_nsxv3.common.synchronization [req-864bcb8a-a518-496c-aebf-9a484ecc9357 req-59df1d81-d455-406f-8f2c-98b77e0d38ad service nova] Enqueued Resource ID: 240839ac-a949-4da3-be33-c0393268a164 with Priority: HIGHEST for action port [ 912.543463] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_rules [ 912.543619] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_members [ 912.543714] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240839ac-a949-4da3-be33-c0393268a164 with Priority: HIGHEST for action port [ 912.544029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-099cf4d4-ded3-44df-b6e7-328bc3763be6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.544429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.544429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.544572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.544707] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.545642] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-099cf4d4-ded3-44df-b6e7-328bc3763be6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.546813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.546970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.547200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.547565] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.547693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.547779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.547959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.548096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.548208] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.549874] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-240839ac-a949-4da3-be33-c0393268a164 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.550038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-240839ac-a949-4da3-be33-c0393268a164" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.550134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-240839ac-a949-4da3-be33-c0393268a164" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.550316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-240839ac-a949-4da3-be33-c0393268a164" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.550433] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240839ac-a949-4da3-be33-c0393268a164',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.052126] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-099cf4d4-ded3-44df-b6e7-328bc3763be6 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.052340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.053660] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 240839ac-a949-4da3-be33-c0393268a164 with status ACTIVE [ 913.053838] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.053948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.054038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.054249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.054339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.054508] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.054602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.054661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.054818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.054894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.055452] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.055560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.055625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.055780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.055855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.055942] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 240839ac-a949-4da3-be33-c0393268a164 is going to be updated. [ 913.057057] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.081204] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.081486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.081585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.081841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.082067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.082287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-240839ac-a949-4da3-be33-c0393268a164" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.464745] env[66157]: INFO networking_nsxv3.common.synchronization [req-b5a5ca9c-ac96-475d-954f-c95b879ac4d0 req-b334bc25-cd6d-4466-b436-9c9711bd72db tempest-ServersV294TestFqdnHostnames-725788328 tempest-ServersV294TestFqdnHostnames-725788328-project-member] Enqueued Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_members [ 913.464745] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_members [ 913.464745] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.464745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.464745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.464745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.465096] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.465171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.465809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.465809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.465809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.465809] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.559723] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.840266] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-43 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.840457] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-43" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.840580] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-43" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.841143] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-43" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.841569] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.841749] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.841867] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.842124] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.842390] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.842637] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.842810] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.842994] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.843172] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.843299] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.843433] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.843615] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.862492] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.862679] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.862815] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.862990] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-43" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.863327] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.863526] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.863621] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.863957] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.864110] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.969091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.969091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.969091] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 already deleted. [ 913.969091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.061783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.061955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.062045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.062278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.062399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.062534] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 is going to be created. [ 914.086593] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.086852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.086923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.087150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.087315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.101478] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 in Status: UNINITIALIZED for 2s [ 914.366592] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.366820] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.366940] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.367278] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.367712] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.367946] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01 not found, creating... [ 914.368298] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.368468] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.368693] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.368830] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.368970] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.369341] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.369516] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.369636] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.369864] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.369996] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.370149] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01 is going to be created. [ 914.395969] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.396205] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.396418] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.396847] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.397156] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.397412] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.114236] env[66157]: INFO networking_nsxv3.common.synchronization [req-b5a5ca9c-ac96-475d-954f-c95b879ac4d0 req-507c7769-730c-4d07-a358-a8118fa8bf32 service nova] Enqueued Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_rules [ 915.114462] env[66157]: INFO networking_nsxv3.common.synchronization [req-b5a5ca9c-ac96-475d-954f-c95b879ac4d0 req-507c7769-730c-4d07-a358-a8118fa8bf32 service nova] Enqueued Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_members [ 915.118025] env[66157]: INFO networking_nsxv3.common.synchronization [req-b5a5ca9c-ac96-475d-954f-c95b879ac4d0 req-507c7769-730c-4d07-a358-a8118fa8bf32 service nova] Enqueued Resource ID: 7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01 with Priority: HIGHEST for action port [ 915.118025] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_rules [ 915.118025] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_members [ 915.118025] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01 with Priority: HIGHEST for action port [ 915.118025] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.118025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.118025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.118025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.118025] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.118517] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.118517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.118583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.118752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.118896] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.118983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.119053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.119185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.119264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.119373] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.120190] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.120276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.120276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.121385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.121385] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.623928] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.624066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.624326] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.627772] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01 with status ACTIVE [ 915.627772] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.627772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.627772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.627772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.628037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.628066] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.628182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.628237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.628452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.628491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.628674] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.628784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.628843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.628980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.629161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.629161] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01 is going to be updated. [ 915.655613] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.655691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.655801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.655982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.657902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.657902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7637e8c2-f2fa-4a96-b42a-5aceb4bd9b01" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.112480] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 in Status: SUCCESS [ 916.112826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.113562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.113734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.114351] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.114648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.114648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.114878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.114967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.115091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.115218] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.131651] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.617995] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.640468] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.640468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.640468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.640468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.640468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.640468] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 is going to be created. [ 916.669927] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.669927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.669927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.669927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.669927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.683971] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 in Status: UNINITIALIZED for 2s [ 917.121216] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 099cf4d4-ded3-44df-b6e7-328bc3763be6: rpc.has_security_group_logging(os_id): False [ 917.150545] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.150776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.150888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.151170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.151312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.151688] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.151813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.151941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.152129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.152211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.152309] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 is going to be created. [ 917.218520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.218782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.218891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.219170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.219424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.231218] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 in Status: IN_PROGRESS for 2s [ 917.250412] env[66157]: INFO networking_nsxv3.common.synchronization [req-00b931df-9e5c-4c0d-992c-33c29a3fbb4b req-f71af991-ead9-42b3-8366-93e51f4953c5 tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 917.251012] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 917.251345] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.251544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.251628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.251897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.252085] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.252193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.252251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.252451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.252570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.252677] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.689370] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.689641] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.689780] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.690123] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.690409] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.690567] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.690670] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.690927] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.691369] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.691604] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.691809] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.693209] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.693410] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.693666] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.693666] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.693775] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.715198] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.715198] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.715198] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.715198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.715198] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-2a37dd86-a825-4196-8824-52f13a6b93ba taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.715198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-2a37dd86-a825-4196-8824-52f13a6b93ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.715432] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-2a37dd86-a825-4196-8824-52f13a6b93ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.715654] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-2a37dd86-a825-4196-8824-52f13a6b93ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.715800] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a37dd86-a825-4196-8824-52f13a6b93ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.754817] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.754969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.755057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.755278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.755367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.755562] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.755658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.755721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.755868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.755942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.756040] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 already deleted. [ 917.756120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.219192] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.219685] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.219758] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.220042] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.220232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.220430] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 2a37dd86-a825-4196-8824-52f13a6b93ba not found, creating... [ 918.220763] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.220997] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.221172] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.221476] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.221650] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.222037] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.222247] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.222394] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.222665] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.222844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.223027] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 2a37dd86-a825-4196-8824-52f13a6b93ba is going to be created. [ 918.244586] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.244819] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.244941] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.245270] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.245514] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.245755] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-2a37dd86-a825-4196-8824-52f13a6b93ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.696276] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 in Status: SUCCESS [ 918.696500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.696703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.696964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.697191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.697338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.697403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.697608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.697689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.697778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.697888] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.968649] env[66157]: INFO networking_nsxv3.common.synchronization [req-00b931df-9e5c-4c0d-992c-33c29a3fbb4b req-610783aa-fd93-4bb0-8dc1-eef87715f27f service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 918.968892] env[66157]: INFO networking_nsxv3.common.synchronization [req-00b931df-9e5c-4c0d-992c-33c29a3fbb4b req-610783aa-fd93-4bb0-8dc1-eef87715f27f service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 918.969045] env[66157]: INFO networking_nsxv3.common.synchronization [req-00b931df-9e5c-4c0d-992c-33c29a3fbb4b req-610783aa-fd93-4bb0-8dc1-eef87715f27f service nova] Enqueued Resource ID: 2a37dd86-a825-4196-8824-52f13a6b93ba with Priority: HIGHEST for action port [ 918.969565] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 918.969763] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 918.969818] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a37dd86-a825-4196-8824-52f13a6b93ba with Priority: HIGHEST for action port [ 918.970240] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.970456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.970530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.970811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.970898] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.971791] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.972400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.972400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.972400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.972400] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.972400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.972692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.972692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.972692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.972809] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.974680] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a37dd86-a825-4196-8824-52f13a6b93ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.974680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a37dd86-a825-4196-8824-52f13a6b93ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.974680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a37dd86-a825-4196-8824-52f13a6b93ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.974680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a37dd86-a825-4196-8824-52f13a6b93ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.975035] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a37dd86-a825-4196-8824-52f13a6b93ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.201245] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.245325] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 in Status: SUCCESS [ 919.245711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.475217] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.477427] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.477560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.477760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a37dd86-a825-4196-8824-52f13a6b93ba with status ACTIVE [ 919.477953] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.478082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.478169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.478357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.478460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.478652] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.478759] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.478787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.479080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.479124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.479286] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.479443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.479544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.479674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.479758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.479843] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a37dd86-a825-4196-8824-52f13a6b93ba is going to be updated. [ 919.501287] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.501472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.501638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.501902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.502119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.502414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a37dd86-a825-4196-8824-52f13a6b93ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.704779] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98809cbd-e3ae-4c26-8c2a-269a263d4ce9: rpc.has_security_group_logging(os_id): False [ 919.725144] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.725332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.725390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.725606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.725697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.725951] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.726067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.726131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.726281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.726356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.726442] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 is going to be created. [ 919.794600] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.794756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.794816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.795054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.795240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.807740] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 in Status: IN_PROGRESS for 2s [ 919.982315] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.999720] env[66157]: INFO networking_nsxv3.common.synchronization [req-2fe81e1c-3efa-4c9b-a27c-21f7db748772 req-5a280a39-b03a-418a-a9fc-f084e00fd7a0 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 920.000293] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 920.000588] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.000738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.000796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.002107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.002107] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.002107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.002107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.002107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.002107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.002107] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.353971] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-204 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.358340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-204" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.358340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-204" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.358340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-204" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.358340] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.358340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.358340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.358340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.358340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.358340] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.358340] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.358340] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.358340] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.358340] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.358340] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.358340] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.392371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.392551] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.392727] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.392902] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-204" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.393238] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-446881bb-e0fb-42c9-97fc-5f2f84f78448 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.393404] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.393521] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.393847] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.394025] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('446881bb-e0fb-42c9-97fc-5f2f84f78448',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.487725] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.487725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.487725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.487725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.487725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.487725] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be created. [ 920.505594] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.515023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.515023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.515023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.515023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.515023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.525555] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: UNINITIALIZED for 2s [ 920.897121] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.897436] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.897540] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.897801] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.897948] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.898136] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 446881bb-e0fb-42c9-97fc-5f2f84f78448 not found, creating... [ 920.898431] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.898591] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.898706] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.898956] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.899127] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.899424] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.899626] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.899767] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.899974] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.900154] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.900295] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 is going to be created. [ 920.921653] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.921933] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.922077] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.922376] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.922613] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.922852] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.007915] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.353201] env[66157]: INFO networking_nsxv3.common.synchronization [req-986c2037-910b-46ab-a42c-79297ae8f538 req-6eeb53ad-c4b4-4180-94d9-db84d5b1595c tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_members [ 921.353872] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGHEST for action security_group_members [ 921.354247] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.354575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.354575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.354648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.354870] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.354973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.355055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.355202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.355293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.355385] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.513246] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.513430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.513520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.514029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.514029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.514154] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 921.545659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.545867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.545922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.546177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.546327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.556650] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 921.661862] env[66157]: INFO networking_nsxv3.common.synchronization [req-2fe81e1c-3efa-4c9b-a27c-21f7db748772 req-fb3d8b81-0935-4c47-bc2b-984d760684d2 service nova] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 921.662059] env[66157]: INFO networking_nsxv3.common.synchronization [req-2fe81e1c-3efa-4c9b-a27c-21f7db748772 req-fb3d8b81-0935-4c47-bc2b-984d760684d2 service nova] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 921.662264] env[66157]: INFO networking_nsxv3.common.synchronization [req-2fe81e1c-3efa-4c9b-a27c-21f7db748772 req-fb3d8b81-0935-4c47-bc2b-984d760684d2 service nova] Enqueued Resource ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 with Priority: HIGHEST for action port [ 921.662777] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 921.662922] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 921.663016] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 with Priority: HIGHEST for action port [ 921.667549] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.667694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.667830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.667986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.668076] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.669403] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.669551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.670077] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-446881bb-e0fb-42c9-97fc-5f2f84f78448 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.670191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.670257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.670682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.670771] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('446881bb-e0fb-42c9-97fc-5f2f84f78448',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.820475] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 in Status: SUCCESS [ 921.820475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.857910] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.858078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.858147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.858363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.858448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.858708] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.858763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.860023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.860023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.860023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.860023] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 is going to be updated. [ 921.891917] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.895941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.895941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.895941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.895941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.905147] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 in Status: IN_PROGRESS for 2s [ 922.172537] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.176840] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 446881bb-e0fb-42c9-97fc-5f2f84f78448 with status ACTIVE [ 922.176840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.176840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.176840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.176840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.177647] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 is going to be updated. [ 922.202657] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.202657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.202657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.202657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.202657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.202657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.549511] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 922.549511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.549511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.549511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.549511] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.549511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.549511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.549511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.549511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.549511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.550576] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.872886] env[66157]: INFO networking_nsxv3.common.synchronization [req-52dffe6d-7cac-4424-80d8-78e417afedcc req-d20b789b-1eee-4b54-9768-f27cf09ae751 tempest-ServerMetadataNegativeTestJSON-1705424689 tempest-ServerMetadataNegativeTestJSON-1705424689-project-member] Enqueued Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGHEST for action security_group_members [ 922.873410] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGHEST for action security_group_members [ 922.873889] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d6f11-6204-4093-b454-2cfd24b63dae taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.873889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.873889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.874791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.874791] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.874791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.874791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.874977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.874977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.875050] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.052795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.052994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.053359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.053359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.053591] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.054136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.054216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.054414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.054511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.054605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.054779] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.054947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.055034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.055192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.055399] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.055498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.055560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.055732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.055822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.055929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.056426] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.374772] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.374943] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-209" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.375022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-209" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.375342] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-209" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.375677] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.375776] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.375855] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.376482] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.376798] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.376968] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.377404] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.377404] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.377404] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.377404] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.377590] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.377624] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.379053] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.379172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.379242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.379401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.379486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.379678] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.379773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.379835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.379977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.380065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.380148] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae already deleted. [ 923.380226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.403224] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.404962] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.404962] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.404962] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-209" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.404962] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-82ffda45-f6f5-4388-8e41-2d2cced283d5 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.406944] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-82ffda45-f6f5-4388-8e41-2d2cced283d5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.406944] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-82ffda45-f6f5-4388-8e41-2d2cced283d5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.406944] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-82ffda45-f6f5-4388-8e41-2d2cced283d5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.406944] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ffda45-f6f5-4388-8e41-2d2cced283d5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.560860] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94: rpc.has_security_group_logging(os_id): False [ 923.570288] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 923.570658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.570905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.571200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.571449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.571590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.571664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.571885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.571975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.576163] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.581616] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.581949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.582051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.582243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.582349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.582632] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.582785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.582879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.583423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.583554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.583879] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.584117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.584117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.584312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.584397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.584595] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.584710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.584776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.584930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.585115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.585216] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be created. [ 923.649333] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.649847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.649847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.649847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.650231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.663244] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 923.910989] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.911843] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.911843] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.911944] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.912160] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.912264] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 82ffda45-f6f5-4388-8e41-2d2cced283d5 not found, creating... [ 923.912627] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.914649] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.914649] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.914649] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.914649] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.914649] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.914649] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.914649] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.915150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.915150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.915150] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 82ffda45-f6f5-4388-8e41-2d2cced283d5 is going to be created. [ 923.916609] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 in Status: SUCCESS [ 923.916791] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 deletion is rescheduled due to dependency. [ 923.916862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.937914] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.938174] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.938298] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.938577] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.938811] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.939046] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-82ffda45-f6f5-4388-8e41-2d2cced283d5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.076110] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.579311] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.718427] env[66157]: INFO networking_nsxv3.common.synchronization [req-52dffe6d-7cac-4424-80d8-78e417afedcc req-a28460ff-a54b-4d36-aa76-094b2b49cdb0 service nova] Enqueued Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGHEST for action security_group_rules [ 924.718606] env[66157]: INFO networking_nsxv3.common.synchronization [req-52dffe6d-7cac-4424-80d8-78e417afedcc req-a28460ff-a54b-4d36-aa76-094b2b49cdb0 service nova] Enqueued Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGHEST for action security_group_members [ 924.718748] env[66157]: INFO networking_nsxv3.common.synchronization [req-52dffe6d-7cac-4424-80d8-78e417afedcc req-a28460ff-a54b-4d36-aa76-094b2b49cdb0 service nova] Enqueued Resource ID: 82ffda45-f6f5-4388-8e41-2d2cced283d5 with Priority: HIGHEST for action port [ 924.719300] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGHEST for action security_group_rules [ 924.719440] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGHEST for action security_group_members [ 924.719538] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ffda45-f6f5-4388-8e41-2d2cced283d5 with Priority: HIGHEST for action port [ 924.719834] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9d6f11-6204-4093-b454-2cfd24b63dae taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.719978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.720033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.720299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.720383] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.721282] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d6f11-6204-4093-b454-2cfd24b63dae taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.721398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.721467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.721645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.721834] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.722109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.722109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.722109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.722233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.722274] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.723205] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-82ffda45-f6f5-4388-8e41-2d2cced283d5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.723322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82ffda45-f6f5-4388-8e41-2d2cced283d5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.723387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82ffda45-f6f5-4388-8e41-2d2cced283d5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.723578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82ffda45-f6f5-4388-8e41-2d2cced283d5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.723637] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ffda45-f6f5-4388-8e41-2d2cced283d5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.081722] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.082016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.082128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.082465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.082584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.083065] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 925.117430] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.117679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.117679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.117884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.118088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.131116] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 925.225573] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.227149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d6f11-6204-4093-b454-2cfd24b63dae taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.227265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.227446] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82ffda45-f6f5-4388-8e41-2d2cced283d5 with status ACTIVE [ 925.227617] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.227795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.227795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.228678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.228678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.228678] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.228678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.228678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.228678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.228951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.228951] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.229921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.230057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.230231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.230351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.230419] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82ffda45-f6f5-4388-8e41-2d2cced283d5 is going to be updated. [ 925.255031] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.255182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.255248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.255446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.255584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.256024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82ffda45-f6f5-4388-8e41-2d2cced283d5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.679770] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 925.679770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.733596] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.238379] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.238379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.238379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.238379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.238379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.238379] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae is going to be created. [ 926.265864] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.265864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.265864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.265864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.265864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.278485] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae in Status: UNINITIALIZED for 2s [ 927.146908] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 927.149191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.149395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.149638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.149844] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.150198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.150198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.150304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.150304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.150430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.150492] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.656877] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.656877] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.656877] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.656877] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.656877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.657679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.657679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.657679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.657679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.657679] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.998960] env[66157]: INFO networking_nsxv3.common.synchronization [None req-7ee209f4-c9e7-498d-bce1-349d889aceda None None] Enqueued Resource ID: ef633c89-d489-463d-8560-b5706ab1b02e with Priority: HIGHEST for action port [ 927.999773] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef633c89-d489-463d-8560-b5706ab1b02e with Priority: HIGHEST for action port [ 928.000665] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef633c89-d489-463d-8560-b5706ab1b02e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.001389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef633c89-d489-463d-8560-b5706ab1b02e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.001775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef633c89-d489-463d-8560-b5706ab1b02e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.002321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef633c89-d489-463d-8560-b5706ab1b02e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.003168] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef633c89-d489-463d-8560-b5706ab1b02e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.161850] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4339fe92-f605-41dc-aba6-ccecae77b024: rpc.has_security_group_logging(os_id): False [ 928.183470] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.183470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.183470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.183470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.183470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.183871] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.184084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.185030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.185030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.185030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.185030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.185338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.185338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.185439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.185556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.185842] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.186020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.186123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.186355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.186490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.186655] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 928.265497] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.265745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.265820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.266049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.266195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.283980] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 928.289877] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae in Status: SUCCESS [ 928.290146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.290342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.290604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.290815] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.291731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.291731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.291731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.291731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.291731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.291731] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.506708] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef633c89-d489-463d-8560-b5706ab1b02e [ 928.509460] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.509460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.509460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.509460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.509460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.509460] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef633c89-d489-463d-8560-b5706ab1b02e already deleted. [ 928.509460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef633c89-d489-463d-8560-b5706ab1b02e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.795193] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d6f11-6204-4093-b454-2cfd24b63dae taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.795481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.795481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.795637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.795805] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.795901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.795964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.796115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.796199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.796346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.796427] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d6f11-6204-4093-b454-2cfd24b63dae taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.796514] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.796571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.796702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.796830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.796915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.796972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.797116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.797192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.797260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.797344] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.306106] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c9d6f11-6204-4093-b454-2cfd24b63dae: rpc.has_security_group_logging(os_id): False [ 929.323253] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.324324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.324324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.324324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.324324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.324324] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.324324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.324324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.324603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.324603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.324854] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.326196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.326196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.326196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.326196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.326196] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.326196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.326196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.326196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.326196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.326196] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae is going to be created. [ 929.393862] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.394016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.394076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.394290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.394473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.409415] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae in Status: IN_PROGRESS for 2s [ 929.530936] env[66157]: INFO networking_nsxv3.common.synchronization [req-1c1f7aa9-a8c3-4edc-bddc-155d5c69db9e req-d2661456-cd0d-4094-badd-123873c48293 tempest-ImagesOneServerNegativeTestJSON-417779338 tempest-ImagesOneServerNegativeTestJSON-417779338-project-member] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 929.531324] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 929.531554] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.532232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.532474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.533547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.534738] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.534738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.534876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.535388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.535388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.535388] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.759220] env[66157]: INFO networking_nsxv3.common.synchronization [None req-a8fae88e-dc92-4522-9216-40c29e74471b tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 929.759695] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 929.760099] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.760228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.760296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.760547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.760629] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.953754] env[66157]: INFO networking_nsxv3.common.synchronization [None req-eb69e654-2972-49b3-88fd-e37f07758169 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 929.954603] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 929.954819] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.954974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.037422] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.037422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.037422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.037768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.037768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.037953] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.038054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.038105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.038226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.038318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.038361] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 already deleted. [ 930.038426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.069569] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.069815] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.069965] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.070297] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.070551] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.070714] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.070820] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.071066] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.071218] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.071446] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.071563] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.071764] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.071764] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.071865] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.071991] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.072133] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.093565] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.093565] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.093565] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.093565] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.094524] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.094524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.094524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.094524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.094524] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c419c2e6-ad40-460b-a8c3-5b9f3a7f9199',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.281052] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.281233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.281270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.281508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.281624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.281699] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 already deleted. [ 930.281839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.282097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.282445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.282515] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.304282] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 930.304683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.600216] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.600868] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.601161] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.601571] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.601807] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.602129] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port c419c2e6-ad40-460b-a8c3-5b9f3a7f9199 not found, creating... [ 930.603558] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.603558] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.603558] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.603558] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.603781] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.603954] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.604135] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.604276] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.604570] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.604725] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.604895] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: c419c2e6-ad40-460b-a8c3-5b9f3a7f9199 is going to be created. [ 930.633661] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.634097] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.634291] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.634808] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.636632] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.636632] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.811102] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.811336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.811395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.811616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.811712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.811816] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 already deleted. [ 930.811904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.891353] env[66157]: INFO networking_nsxv3.common.synchronization [None req-ebf902cf-dcbe-4c7e-a823-f4f1aad6c7f5 None None] Enqueued Resource ID: 76ad611a-f581-4a3d-a85f-9540a44a9281 with Priority: HIGHEST for action port [ 930.891353] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ad611a-f581-4a3d-a85f-9540a44a9281 with Priority: HIGHEST for action port [ 930.891353] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-76ad611a-f581-4a3d-a85f-9540a44a9281 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.891353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76ad611a-f581-4a3d-a85f-9540a44a9281" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.891353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76ad611a-f581-4a3d-a85f-9540a44a9281" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.891353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76ad611a-f581-4a3d-a85f-9540a44a9281" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.891353] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76ad611a-f581-4a3d-a85f-9540a44a9281',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.360207] env[66157]: INFO networking_nsxv3.common.synchronization [req-1c1f7aa9-a8c3-4edc-bddc-155d5c69db9e req-84403b5c-7dc9-4852-be98-ae77629fb260 service nova] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_rules [ 931.360207] env[66157]: INFO networking_nsxv3.common.synchronization [req-1c1f7aa9-a8c3-4edc-bddc-155d5c69db9e req-84403b5c-7dc9-4852-be98-ae77629fb260 service nova] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 931.360431] env[66157]: INFO networking_nsxv3.common.synchronization [req-1c1f7aa9-a8c3-4edc-bddc-155d5c69db9e req-84403b5c-7dc9-4852-be98-ae77629fb260 service nova] Enqueued Resource ID: c419c2e6-ad40-460b-a8c3-5b9f3a7f9199 with Priority: HIGHEST for action port [ 931.362433] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_rules [ 931.362433] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 931.362433] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c419c2e6-ad40-460b-a8c3-5b9f3a7f9199 with Priority: HIGHEST for action port [ 931.362433] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.362433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.362433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.363352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.363352] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.363535] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.365661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.365770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.365969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.366155] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.366424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.366492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.367659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.367659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.367659] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.367659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.368178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.368178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.368178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.368178] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c419c2e6-ad40-460b-a8c3-5b9f3a7f9199',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.396284] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76ad611a-f581-4a3d-a85f-9540a44a9281 [ 931.396284] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.396284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.396284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.396284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.396284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.396284] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76ad611a-f581-4a3d-a85f-9540a44a9281 already deleted. [ 931.396284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76ad611a-f581-4a3d-a85f-9540a44a9281" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.424185] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae in Status: SUCCESS [ 931.424185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.834299] env[66157]: INFO networking_nsxv3.common.synchronization [req-284f3f85-890d-4458-a267-bcc9336d0a8b req-4eba0784-0bdf-4d43-bc92-2b6e614a169d tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 931.834612] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 931.834784] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.834904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.834966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.837030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.837030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.837030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.837030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.837457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.837673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.837780] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.869834] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.870138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.871295] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c419c2e6-ad40-460b-a8c3-5b9f3a7f9199 with status ACTIVE [ 931.871489] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.871629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.871689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.871973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.872107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.872323] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.872411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.872449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.872591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.872670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.872895] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.873019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.873019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.873213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.873275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.873387] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c419c2e6-ad40-460b-a8c3-5b9f3a7f9199 is going to be updated. [ 931.874399] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.901245] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.901245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.901245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.901245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.901245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.901245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c419c2e6-ad40-460b-a8c3-5b9f3a7f9199" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.340889] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.341641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.341641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.341641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.341641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.341879] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.341879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.341879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.341987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.342125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.342190] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 932.345368] env[66157]: INFO networking_nsxv3.common.synchronization [None req-031126c0-e139-46c5-bc00-f62226e78a7b tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: a08588b6-0c1a-4b31-8ae1-59e2814f6a1b with Priority: HIGHEST for action security_group_rules [ 932.346264] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08588b6-0c1a-4b31-8ae1-59e2814f6a1b with Priority: HIGHEST for action security_group_rules [ 932.347027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.347027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.347027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.347027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.347238] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a08588b6-0c1a-4b31-8ae1-59e2814f6a1b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.378068] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.381122] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.381363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.382626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.382626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.382626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.397115] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 932.488808] env[66157]: INFO networking_nsxv3.common.synchronization [None req-2f3c59c4-5829-4ad4-8557-54aa3da42886 tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: a08588b6-0c1a-4b31-8ae1-59e2814f6a1b with Priority: HIGHEST for action security_group_rules [ 932.489192] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08588b6-0c1a-4b31-8ae1-59e2814f6a1b with Priority: HIGHEST for action security_group_rules [ 932.489666] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.489666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.874939] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.875255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.875255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.876221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.876221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.876221] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a08588b6-0c1a-4b31-8ae1-59e2814f6a1b already deleted. [ 932.876221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.876221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.876221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.876221] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a08588b6-0c1a-4b31-8ae1-59e2814f6a1b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.879921] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.880064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.880137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.880302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.880397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.880491] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be created. [ 932.908661] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.908661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.908893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.909344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.909518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.922961] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: UNINITIALIZED for 2s [ 933.397471] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.397655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.397706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.398095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.398095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.398095] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a08588b6-0c1a-4b31-8ae1-59e2814f6a1b already deleted. [ 933.398257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a08588b6-0c1a-4b31-8ae1-59e2814f6a1b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.408232] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e5b8bc8-239d-45bf-bbf9-996c06f31708 req-2fdfb127-84f8-4207-992e-666c64f3f9ae tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 934.408577] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e5b8bc8-239d-45bf-bbf9-996c06f31708 req-2fdfb127-84f8-4207-992e-666c64f3f9ae tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 934.409603] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 934.409603] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 934.412124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.412124] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 934.412124] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 934.412124] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.412124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.412124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.412124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.412124] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.412124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.412124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.412124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.412124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.412124] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.412915] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-90751d4a-0d47-4c8f-96a3-70d21b421ce5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.412991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.414036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.414036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.414036] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.414036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.414036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.414036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.414036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.414036] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.457982] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e5b8bc8-239d-45bf-bbf9-996c06f31708 req-2fdfb127-84f8-4207-992e-666c64f3f9ae tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 934.458151] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e5b8bc8-239d-45bf-bbf9-996c06f31708 req-2fdfb127-84f8-4207-992e-666c64f3f9ae tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 934.458309] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e5b8bc8-239d-45bf-bbf9-996c06f31708 req-2fdfb127-84f8-4207-992e-666c64f3f9ae tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_rules [ 934.458431] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e5b8bc8-239d-45bf-bbf9-996c06f31708 req-2fdfb127-84f8-4207-992e-666c64f3f9ae tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 934.458558] env[66157]: INFO networking_nsxv3.common.synchronization [req-4e5b8bc8-239d-45bf-bbf9-996c06f31708 req-2fdfb127-84f8-4207-992e-666c64f3f9ae tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 with Priority: HIGHEST for action port [ 934.459266] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 934.459419] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_rules [ 934.459518] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 with Priority: HIGHEST for action port [ 934.459611] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 934.459697] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 934.460316] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.460451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.460544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.460802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.460802] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.462719] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.462829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.462829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.463093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.463314] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.466659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-446881bb-e0fb-42c9-97fc-5f2f84f78448 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.466659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.466659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.466659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.466659] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('446881bb-e0fb-42c9-97fc-5f2f84f78448',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.467711] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.467848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.468322] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-90751d4a-0d47-4c8f-96a3-70d21b421ce5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.469583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.915452] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.916514] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.933422] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 934.933633] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.933899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.934155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.935046] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.935046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.935046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.935046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.935046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.935046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.935345] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.962969] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.962969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.974023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-90751d4a-0d47-4c8f-96a3-70d21b421ce5 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.974023] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 446881bb-e0fb-42c9-97fc-5f2f84f78448 with status ACTIVE [ 934.974023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.974023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.974023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.974023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.974670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.974670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.974670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.974670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.974670] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 is going to be updated. [ 934.997726] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.997880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.997950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.998173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.998321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.998479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.067025] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b5405a8-fe4d-4ccc-b390-3e0954881028 req-ae895da1-4319-4adc-9eb8-87083a75f0ba tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_members [ 935.068040] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_members [ 935.070108] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bb5a370-76e0-4d7c-9a46-84239200c704 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.070108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.070108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.070108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.070108] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.070108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.070108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.070108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.070108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.070108] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.417847] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.419079] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.440018] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.440451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.440540] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.440760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.440936] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.441056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.441115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.441259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.441340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.441424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.441585] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.441651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.441707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.441838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.441964] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.442057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.442111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.442290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.442366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.442742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.442742] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.509235] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.509565] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.509708] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.510143] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.510359] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.510531] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.510653] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.510879] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.513062] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.513062] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.513062] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.513062] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.513062] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.513062] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.513062] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.513407] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.534752] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.535099] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.535441] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.535646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.535972] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.536173] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.536298] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.536618] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.536758] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c91fa6d2-c1e9-4c60-92fe-365fb37666e9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.572324] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.572537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.572537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.572783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.572868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.573091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.573211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.573325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.573398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.573447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.573556] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 already deleted. [ 935.573611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.922778] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.922945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.922945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.923186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.923278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.923411] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 935.924752] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.924878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.924926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.925143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.925225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.925315] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 is going to be created. [ 935.947533] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83a8fa88-5bec-4b31-8608-ce09049bd610: rpc.has_security_group_logging(os_id): False [ 935.956955] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.957240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.957240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.957457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.957591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.959770] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.959912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.959953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.960169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.960328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.982644] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.982644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.982772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.982923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.983035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.983260] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.983364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.983432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.983570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.983646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.983823] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.983915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.983971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.984122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.984195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.984432] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.984570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.984636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.984778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.984853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.984936] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be created. [ 935.986750] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 935.987350] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 in Status: UNINITIALIZED for 2s [ 936.039132] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.039397] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.039466] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.039745] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.039894] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.040068] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port c91fa6d2-c1e9-4c60-92fe-365fb37666e9 not found, creating... [ 936.040407] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.040559] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.040678] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.040903] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.041164] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.041470] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.041727] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.041923] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.042279] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.042515] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.042764] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: c91fa6d2-c1e9-4c60-92fe-365fb37666e9 is going to be created. [ 936.054837] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.055132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.055132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.055299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.055494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.070659] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 936.087391] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.087773] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.088020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.088443] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.088820] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.089183] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.874840] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b5405a8-fe4d-4ccc-b390-3e0954881028 req-4a3216c7-dd04-4ed9-ac9b-a8c5e1de4f49 service nova] Enqueued Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_rules [ 936.875217] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b5405a8-fe4d-4ccc-b390-3e0954881028 req-4a3216c7-dd04-4ed9-ac9b-a8c5e1de4f49 service nova] Enqueued Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_members [ 936.875288] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b5405a8-fe4d-4ccc-b390-3e0954881028 req-4a3216c7-dd04-4ed9-ac9b-a8c5e1de4f49 service nova] Enqueued Resource ID: c91fa6d2-c1e9-4c60-92fe-365fb37666e9 with Priority: HIGHEST for action port [ 936.875935] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_rules [ 936.876204] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_members [ 936.876339] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c91fa6d2-c1e9-4c60-92fe-365fb37666e9 with Priority: HIGHEST for action port [ 936.876647] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bb5a370-76e0-4d7c-9a46-84239200c704 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.876787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.876895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.877072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.877156] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.878162] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bb5a370-76e0-4d7c-9a46-84239200c704 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.881519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.881519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.881519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.881519] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.881733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.881733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.884931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.884931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.884931] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.884931] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.886839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.886979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.887156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.887269] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c91fa6d2-c1e9-4c60-92fe-365fb37666e9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.332435] env[66157]: INFO networking_nsxv3.common.synchronization [req-23508cc4-1333-4829-a6ff-244ccbf39616 req-23f309c3-eccc-4994-9224-2d8281a907c1 tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 937.332435] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 937.332435] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.332774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.332774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.332774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.332909] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.333089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.333089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.333265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.333331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.333427] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.391158] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.392449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bb5a370-76e0-4d7c-9a46-84239200c704 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.392449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.392773] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c91fa6d2-c1e9-4c60-92fe-365fb37666e9 with status ACTIVE [ 937.392934] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.393050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.393114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.393319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.393404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.398784] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.398784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.398784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.398784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.398784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.398784] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.398784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.398784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.398784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.398784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.398784] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c91fa6d2-c1e9-4c60-92fe-365fb37666e9 is going to be updated. [ 937.427119] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.430376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.430376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.430376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.430376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.430376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c91fa6d2-c1e9-4c60-92fe-365fb37666e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.836542] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.836698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.836769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.837074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.837175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.837379] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.837481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.837550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.837748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.837821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.837939] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 937.869530] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.872548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.872548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.872548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.872548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.881860] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 937.894746] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.916032] env[66157]: INFO networking_nsxv3.common.synchronization [None req-4c32e67f-a359-48e4-8470-5fc32383427e None None] Enqueued Resource ID: f221d8c0-4b13-4162-9a85-f09ab8d29427 with Priority: HIGHEST for action port [ 937.916032] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f221d8c0-4b13-4162-9a85-f09ab8d29427 with Priority: HIGHEST for action port [ 937.916032] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-f221d8c0-4b13-4162-9a85-f09ab8d29427 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.916032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f221d8c0-4b13-4162-9a85-f09ab8d29427" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.916032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f221d8c0-4b13-4162-9a85-f09ab8d29427" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.916725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f221d8c0-4b13-4162-9a85-f09ab8d29427" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.916932] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f221d8c0-4b13-4162-9a85-f09ab8d29427',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.004851] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 938.004851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.004851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.004851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.004851] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.004851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.004851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.004851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.004851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.004851] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.007044] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 in Status: SUCCESS [ 938.007359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.007940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.008780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.009041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.009194] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.009278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.009485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.009590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.009713] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.085344] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 938.085344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.398158] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.398894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.398894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.398894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.398894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.398894] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 is going to be created. [ 938.423170] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f221d8c0-4b13-4162-9a85-f09ab8d29427 [ 938.423304] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.424156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.424309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.424992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.425257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.425488] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f221d8c0-4b13-4162-9a85-f09ab8d29427 already deleted. [ 938.425606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f221d8c0-4b13-4162-9a85-f09ab8d29427" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.446473] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.446473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.446473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.446740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.449044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.461629] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 in Status: UNINITIALIZED for 2s [ 938.512911] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.513897] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.017596] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.019529] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.522215] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.522215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.522215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.522215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.522215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.522215] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 939.523740] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.523999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.524158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.525295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.525295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.525295] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 is going to be updated. [ 939.552031] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.553416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.553416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.553416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.553416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.557293] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.557293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.557293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.557293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.557293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.582479] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 939.582479] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 in Status: IN_PROGRESS for 2s [ 939.699160] env[66157]: INFO networking_nsxv3.common.synchronization [req-4f16bd56-5f3d-4be0-bc01-232b3f789179 req-3acb38d3-ad16-467f-92da-2e02375b42cf tempest-MigrationsAdminTest-406320684 tempest-MigrationsAdminTest-406320684-project-member] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 939.700220] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 939.701065] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.701260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.701376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.701715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.701981] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.702172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.702295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.702574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.703278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.703348] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.894654] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 939.894654] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 939.894654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.206425] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.480093] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 in Status: SUCCESS [ 940.480370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.481135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.481458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.481755] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.481950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.482045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.482249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.482385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.482546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.482638] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.530828] env[66157]: INFO networking_nsxv3.common.synchronization [None req-ff398db0-5616-4598-8f87-7c9459a291d8 None None] Enqueued Resource ID: 72dc1845-a3cf-4b09-9d5a-5867b77140b0 with Priority: HIGHEST for action port [ 940.531842] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72dc1845-a3cf-4b09-9d5a-5867b77140b0 with Priority: HIGHEST for action port [ 940.532649] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-72dc1845-a3cf-4b09-9d5a-5867b77140b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.532851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72dc1845-a3cf-4b09-9d5a-5867b77140b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.532948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72dc1845-a3cf-4b09-9d5a-5867b77140b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.533721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72dc1845-a3cf-4b09-9d5a-5867b77140b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.533721] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72dc1845-a3cf-4b09-9d5a-5867b77140b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.594951] env[66157]: INFO networking_nsxv3.common.synchronization [req-97263d04-3a20-40c4-bec0-3acc03613077 req-fc47dd47-b5b1-41fb-b123-639b126bfeca tempest-ServersAdminTestJSON-1739826864 tempest-ServersAdminTestJSON-1739826864-project-member] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 940.598038] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 940.598038] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.598038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.598038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.598038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.598038] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.598038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.598038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.598038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.598471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.598471] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.709644] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.985256] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.035195] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72dc1845-a3cf-4b09-9d5a-5867b77140b0 [ 941.035418] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.035549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.035769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.035990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.036115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.036222] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72dc1845-a3cf-4b09-9d5a-5867b77140b0 already deleted. [ 941.036307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72dc1845-a3cf-4b09-9d5a-5867b77140b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.101230] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.213492] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.213900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.213900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.214093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.214255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.214372] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 is going to be updated. [ 941.244028] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.244177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.244221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.244438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.244601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.255675] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: IN_PROGRESS for 2s [ 941.487893] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bb5a370-76e0-4d7c-9a46-84239200c704: rpc.has_security_group_logging(os_id): False [ 941.508859] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.509049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.509214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.509489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.509796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.509988] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.510129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.510201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.510363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.510442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.510533] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 is going to be created. [ 941.572884] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.574038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.574038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.574038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.574038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.594949] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 in Status: IN_PROGRESS for 2s [ 941.596914] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 941.597197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.600046] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 in Status: SUCCESS [ 941.600046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.600046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.600046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.600046] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.600046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.600351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.600351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.600351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.600741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.600741] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.601461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.601699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.601884] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.601987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.603028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.603028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.603028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.603028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.603299] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.607330] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.695567] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 941.695745] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 with Priority: HIGHEST for action security_group_members [ 941.695880] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 941.696441] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 941.697356] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 with Priority: HIGHEST for action security_group_members [ 941.697356] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 941.697356] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-90751d4a-0d47-4c8f-96a3-70d21b421ce5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.697356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.697356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.697594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.697594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.697660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.702188] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.702188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed0025b-9e99-4152-86b9-a9389f997b58 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.702188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.702188] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.702188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.702188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.703619] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.703619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.703619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.703619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.703619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.703619] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.805038] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 941.805251] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 941.805425] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 with Priority: HIGHEST for action security_group_rules [ 941.805605] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 with Priority: HIGHEST for action security_group_members [ 941.805713] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_rules [ 941.806184] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 941.806184] env[66157]: INFO networking_nsxv3.common.synchronization [req-4b479799-bdec-4b36-8d70-2ac389a57456 req-71106541-10be-49e6-8488-f06b3996c67e tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 with Priority: HIGHEST for action port [ 941.807263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_rules [ 941.807263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 with Priority: HIGHEST for action security_group_rules [ 941.807263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 941.807263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 with Priority: HIGHEST for action port [ 941.807263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_rules [ 941.807263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 941.807263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 with Priority: HIGHEST for action security_group_members [ 941.807531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.807673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.807759] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ed0025b-9e99-4152-86b9-a9389f997b58 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.807872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.807909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.808197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.808279] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.813943] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-90751d4a-0d47-4c8f-96a3-70d21b421ce5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.814073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.814310] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-446881bb-e0fb-42c9-97fc-5f2f84f78448 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.814431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.814463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.814689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.814771] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('446881bb-e0fb-42c9-97fc-5f2f84f78448',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.817408] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.817530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.817817] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.817931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.818188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed0025b-9e99-4152-86b9-a9389f997b58 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.818302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.896866] env[66157]: INFO networking_nsxv3.common.synchronization [req-8bfebbab-5f25-41f9-9700-24198aae66e0 req-04d9717f-57ee-43ee-8ad8-1bd9bef638d3 tempest-ServerMetadataNegativeTestJSON-1705424689 tempest-ServerMetadataNegativeTestJSON-1705424689-project-member] Enqueued Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGHEST for action security_group_members [ 941.897455] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGHEST for action security_group_members [ 941.897785] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9d6f11-6204-4093-b454-2cfd24b63dae taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.897908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.897972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.898460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.899335] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.899703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.900025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.900425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.900541] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.900668] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.105773] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.107144] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.107144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.109877] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.111023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.111173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.112022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.112022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.112022] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 942.139954] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.139954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.139954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.140174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.140310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.149506] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 942.205921] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.207788] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.208568] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.319598] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed0025b-9e99-4152-86b9-a9389f997b58 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.319598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.322653] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 446881bb-e0fb-42c9-97fc-5f2f84f78448 with status ACTIVE [ 942.322653] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.322653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.322653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.323020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.323020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.323110] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.323767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.323767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.323767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.323917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.324018] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.324133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.324256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.324477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.324563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.324660] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 446881bb-e0fb-42c9-97fc-5f2f84f78448 is going to be updated. [ 942.373077] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.376214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.376214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.376214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.376214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.376214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-446881bb-e0fb-42c9-97fc-5f2f84f78448" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.403906] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.404176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.404294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.404533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.404633] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.404930] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.405087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.405158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.405325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.405405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.405501] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae is going to be updated. [ 942.446501] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.446690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.449933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.450290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.450482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.467086] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae in Status: IN_PROGRESS for 2s [ 942.608503] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90751d4a-0d47-4c8f-96a3-70d21b421ce5: rpc.has_security_group_logging(os_id): False [ 942.640676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.640676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.640676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.640676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.640676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.640989] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.640989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.640989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.640989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.641270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.641270] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 is going to be created. [ 942.711049] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.712031] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.714428] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.815140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.815140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.815140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.815140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.815140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.827288] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 in Status: IN_PROGRESS for 2s [ 943.217574] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.217574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.217574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.217906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.217906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.217906] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 is going to be created. [ 943.219999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.219999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.219999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.219999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.219999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.219999] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 is going to be updated. [ 943.221588] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.221588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.221588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.221588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.221887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.221887] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 943.281286] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: SUCCESS [ 943.281286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.290177] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.290904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.291489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.292124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.292856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.307041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.307041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.307041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.309713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.310243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.315036] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.315036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.315036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.315036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.315036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.318990] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 in Status: UNINITIALIZED for 2s [ 943.329363] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 943.331701] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 in Status: IN_PROGRESS for 2s [ 943.610176] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 in Status: SUCCESS [ 943.610176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.159774] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 944.159774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.476442] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae in Status: SUCCESS [ 944.476721] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae deletion is rescheduled due to dependency. [ 944.476721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.574324] env[66157]: INFO networking_nsxv3.common.synchronization [req-c3623457-6603-49d0-9d69-f24a4018beb1 req-8f07cd9e-e86a-4e77-b9ea-6098254f3ad0 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 944.574324] env[66157]: INFO networking_nsxv3.common.synchronization [req-c3623457-6603-49d0-9d69-f24a4018beb1 req-8f07cd9e-e86a-4e77-b9ea-6098254f3ad0 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 944.574324] env[66157]: INFO networking_nsxv3.common.synchronization [req-c3623457-6603-49d0-9d69-f24a4018beb1 req-8f07cd9e-e86a-4e77-b9ea-6098254f3ad0 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 with Priority: HIGHEST for action security_group_members [ 944.577029] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 944.577029] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 with Priority: HIGHEST for action security_group_members [ 944.577029] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 with Priority: HIGHEST for action security_group_members [ 944.577029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.577029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.577029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-90751d4a-0d47-4c8f-96a3-70d21b421ce5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.577029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.577029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ed0025b-9e99-4152-86b9-a9389f997b58 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.577029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.840191] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 in Status: SUCCESS [ 944.840425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.840620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.841132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.841132] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.330187] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 in Status: SUCCESS [ 945.330336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.331807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.332230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.332461] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.332661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.332711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.332882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.332980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.333303] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.344700] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 in Status: SUCCESS [ 945.344975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.346247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.346331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.346534] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.346613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.346681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.346840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.346919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.347024] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.349082] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 945.349250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.349713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.349934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.350154] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.350300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.350372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.350469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.350546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.350638] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.370840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.371152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.371152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.371337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.371337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.371431] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 is going to be deleted. [ 945.432082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.432082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.432082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.432082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.432082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.432082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.838033] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.838033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.838033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.838033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.838490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.838490] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.838490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.838490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.838637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.838665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.838742] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 is going to be deleted. [ 945.852737] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.852923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.852964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.853183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.853267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.853470] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.853591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.853671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.853829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.853903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.853988] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 is going to be deleted. [ 945.855067] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.884594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.884803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.884897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.885087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.885215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.885334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.885897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.886132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.886288] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.886464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.886510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.886644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.886778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.886848] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90751d4a-0d47-4c8f-96a3-70d21b421ce5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.888816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.888924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.888992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.889157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.889237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.889330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.889465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.889603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.889752] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.889846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.889907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.890168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.890253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.890340] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.358880] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.391933] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.392120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.392338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.392454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.392549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.392854] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.393000] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.393062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.393222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.393297] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.393383] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90751d4a-0d47-4c8f-96a3-70d21b421ce5 already deleted. [ 946.393460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90751d4a-0d47-4c8f-96a3-70d21b421ce5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394441] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.394441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.394441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.394441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.394441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394441] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.394441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.394441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.394807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.394807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394807] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 already deleted. [ 946.394807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394923] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.395739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.395916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.396067] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.396186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.396225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.396356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.396431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.396517] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.565351] env[66157]: INFO networking_nsxv3.common.synchronization [req-70f94319-914c-44e4-b68b-c588fb85daf0 req-f541cc2b-1c0a-4955-bc9b-aa19726942c5 tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 946.565543] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 946.566000] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.566106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.566159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.566325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.566485] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.566582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.566642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.566798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.566884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.566977] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.861468] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.861776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.861882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.862222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.862329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.862437] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 946.892278] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.892435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.892501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.892791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.893358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.897991] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ed0025b-9e99-4152-86b9-a9389f997b58',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.899037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.899162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.899231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.899419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.899495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.899678] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.899776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.899872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.899981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.900067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.900150] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 already deleted. [ 946.900235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.903766] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 946.912626] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.912828] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.912957] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.913211] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.913464] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.913617] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.913732] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.913939] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.914329] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.914329] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.914440] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.914508] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.914609] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.914714] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.914815] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.914936] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.941269] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.941453] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 946.941586] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.941774] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.942157] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-25625966-63e0-46b0-97e2-7d3d2359d8a5 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.942412] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-25625966-63e0-46b0-97e2-7d3d2359d8a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.942547] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-25625966-63e0-46b0-97e2-7d3d2359d8a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.942883] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-25625966-63e0-46b0-97e2-7d3d2359d8a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.943048] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25625966-63e0-46b0-97e2-7d3d2359d8a5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.069836] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.401216] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ed0025b-9e99-4152-86b9-a9389f997b58: rpc.has_security_group_logging(os_id): False [ 947.420421] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.420639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.420639] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.420949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.421056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.421323] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.421446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.421534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.421719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.421816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.421931] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 is going to be created. [ 947.438825] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/7ed0025b-9e99-4152-86b9-a9389f997b58], does not exist path=[/infra/domains/default/groups/7ed0025b-9e99-4152-86b9-a9389f997b58]."\n}' [ 947.438961] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7ed0025b-9e99-4152-86b9-a9389f997b58 [ 947.439058] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 947.448763] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.448972] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.449116] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.449371] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.449516] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.449665] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 25625966-63e0-46b0-97e2-7d3d2359d8a5 not found, creating... [ 947.449915] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.450084] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.450200] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.450456] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.450648] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.450939] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.451107] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.451222] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.451422] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.451552] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.451687] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 25625966-63e0-46b0-97e2-7d3d2359d8a5 is going to be created. [ 947.468928] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.469139] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.469260] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.469513] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.469737] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.470020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-25625966-63e0-46b0-97e2-7d3d2359d8a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.476964] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.477111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.477154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.477379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.478443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.478702] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.478808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.478872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.479034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.479112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.479299] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.479388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.479449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.479586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.479660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.479742] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ed0025b-9e99-4152-86b9-a9389f997b58 is going to be created. [ 947.497473] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/7ed0025b-9e99-4152-86b9-a9389f997b58], does not exist path=[/infra/domains/default/groups/7ed0025b-9e99-4152-86b9-a9389f997b58]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7ed0025b-9e99-4152-86b9-a9389f997b58 [ 947.497631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ed0025b-9e99-4152-86b9-a9389f997b58" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.497849] env[66157]: Traceback (most recent call last): [ 947.497884] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 947.497884] env[66157]: return func(*args, **kwargs) [ 947.497884] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 947.497884] env[66157]: res.raise_for_status() [ 947.497884] env[66157]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 947.497884] env[66157]: raise HTTPError(http_error_msg, response=self) [ 947.497884] env[66157]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7ed0025b-9e99-4152-86b9-a9389f997b58 [ 947.497884] env[66157]: During handling of the above exception, another exception occurred: [ 947.497884] env[66157]: Traceback (most recent call last): [ 947.498157] env[66157]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 947.498157] env[66157]: listener.cb(fileno) [ 947.498157] env[66157]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 947.498157] env[66157]: result = function(*args, **kwargs) [ 947.498157] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 947.498157] env[66157]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 947.498157] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 947.498157] env[66157]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 947.498157] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 947.498157] env[66157]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 947.498157] env[66157]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 947.498157] env[66157]: res.raise_for_status() [ 947.498157] env[66157]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 947.498157] env[66157]: raise HTTPError(http_error_msg, response=self) [ 947.498157] env[66157]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7ed0025b-9e99-4152-86b9-a9389f997b58 [ 947.498157] env[66157]: Removing descriptor: 66 [ 947.572782] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.077265] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.077609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.077609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.077738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.077795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.077908] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 948.108638] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.108813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.108852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.109072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.109300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.131095] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 948.244301] env[66157]: INFO networking_nsxv3.common.synchronization [req-70f94319-914c-44e4-b68b-c588fb85daf0 req-c1cf0b38-590d-40fc-9a44-4b24daeff18a service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 948.244483] env[66157]: INFO networking_nsxv3.common.synchronization [req-70f94319-914c-44e4-b68b-c588fb85daf0 req-c1cf0b38-590d-40fc-9a44-4b24daeff18a service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 948.244624] env[66157]: INFO networking_nsxv3.common.synchronization [req-70f94319-914c-44e4-b68b-c588fb85daf0 req-c1cf0b38-590d-40fc-9a44-4b24daeff18a service nova] Enqueued Resource ID: 25625966-63e0-46b0-97e2-7d3d2359d8a5 with Priority: HIGHEST for action port [ 948.245475] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 948.245475] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 948.245475] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25625966-63e0-46b0-97e2-7d3d2359d8a5 with Priority: HIGHEST for action port [ 948.245779] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.246033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.246033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.246403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.246458] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.249027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.249027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.249027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-25625966-63e0-46b0-97e2-7d3d2359d8a5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.249198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25625966-63e0-46b0-97e2-7d3d2359d8a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.249198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25625966-63e0-46b0-97e2-7d3d2359d8a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.249355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25625966-63e0-46b0-97e2-7d3d2359d8a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.249623] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25625966-63e0-46b0-97e2-7d3d2359d8a5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.749769] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.749902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.752323] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25625966-63e0-46b0-97e2-7d3d2359d8a5 with status ACTIVE [ 948.752557] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.752716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.752869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.753129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.753242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.753473] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.753544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.753594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.753747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.753865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.754031] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.754163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.754218] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.754321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.754391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.754480] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25625966-63e0-46b0-97e2-7d3d2359d8a5 is going to be updated. [ 948.778944] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.779175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.779356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.779685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.779950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.780398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25625966-63e0-46b0-97e2-7d3d2359d8a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.916537] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 948.916693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.916950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.917847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.917847] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.917847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.917847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.918143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.918143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.918219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.918367] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.918452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.918509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.918677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.918833] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.918928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.918988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.919173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.919976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.919976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.919976] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.920583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.920654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.921260] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.921260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.921260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.921425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.921520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.921669] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.423974] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4339fe92-f605-41dc-aba6-ccecae77b024: rpc.has_security_group_logging(os_id): False [ 949.426410] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.444520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.444717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.444717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.444818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.479388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.479487] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.479621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.479621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.479815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.479908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.480118] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.480219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.480281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.480521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.480521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.481106] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.481106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.481106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.481384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.481483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.481581] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 949.551101] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.551292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.551292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.551555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.551720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.589524] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 949.930409] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.143328] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 950.143605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.143862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.144110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.144295] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.144415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.144479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.144629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.144707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.144800] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.433351] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.433801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.433801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.433801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.433930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.433989] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 950.464478] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.464706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.464706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.464900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.465062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.475683] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 950.646730] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.035200] env[66157]: INFO networking_nsxv3.common.synchronization [req-7bac0325-cf36-4515-8e37-4f87d24e33bc req-008ac373-eca2-42bc-8b6d-ab1cc30185be tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_members [ 951.036731] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGHEST for action security_group_members [ 951.036731] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.036731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.036731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.037069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.037210] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.037382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.037484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.037764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.037922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.038106] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.148837] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.172275] env[66157]: INFO networking_nsxv3.common.synchronization [req-9866db29-aac3-44ca-8bf5-48bb2507b835 req-d671d168-727c-4f81-9764-c8ff8e1cdbbb tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 951.172275] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 951.172275] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.172275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.172275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.173086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.173343] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.173578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.173732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.174144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.174364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.174547] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.507673] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.507965] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-252" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.507965] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-252" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.508244] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-252" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.508498] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.508706] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.508843] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.509075] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.509208] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.509472] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.510345] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.510345] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.510345] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.510345] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.510345] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.510345] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.530680] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.530854] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.531015] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.531213] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-252" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.531544] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-50a3b9ca-c1b8-41b7-95bf-c0865270c868 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.531765] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.531890] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.532217] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.532355] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50a3b9ca-c1b8-41b7-95bf-c0865270c868',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.541381] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.541518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.542128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.542128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.564096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.564390] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.564582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.564618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.564798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.564883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.564972] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c is going to be updated. [ 951.604510] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.604711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.605423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.605423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.605423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.608635] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 951.608885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.609110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.609334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.609451] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.615191] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc8d54c1-30b0-4581-9d61-8b194199903c in Status: IN_PROGRESS for 2s [ 951.651310] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.651656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.651656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.651867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.651867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.651950] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 951.677110] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.677229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.677229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.677509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.677638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.678159] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.678159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.678159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.678376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.678749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.678749] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 already deleted. [ 951.678862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.684298] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.685427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.685619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.685926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.686197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.698976] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 952.035068] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.035300] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.035402] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.035635] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.035785] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.036010] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 50a3b9ca-c1b8-41b7-95bf-c0865270c868 not found, creating... [ 952.036279] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.036436] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.036562] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.036776] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.036913] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.037213] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.037442] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.037613] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.037903] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.038067] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.038210] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 is going to be created. [ 952.057708] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.057975] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.058125] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.058393] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.058630] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.058850] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.112173] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.112394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.485791] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 952.486018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.486196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.486407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.486594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.486706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.486770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.486939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.487025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.487112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.487204] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.833025] env[66157]: INFO networking_nsxv3.common.synchronization [req-9866db29-aac3-44ca-8bf5-48bb2507b835 req-07099ed7-b33f-4bd0-b5c8-1bda640ab632 service nova] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 952.833025] env[66157]: INFO networking_nsxv3.common.synchronization [req-9866db29-aac3-44ca-8bf5-48bb2507b835 req-07099ed7-b33f-4bd0-b5c8-1bda640ab632 service nova] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 952.833025] env[66157]: INFO networking_nsxv3.common.synchronization [req-9866db29-aac3-44ca-8bf5-48bb2507b835 req-07099ed7-b33f-4bd0-b5c8-1bda640ab632 service nova] Enqueued Resource ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with Priority: HIGHEST for action port [ 952.833025] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 952.833025] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 952.833025] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with Priority: HIGHEST for action port [ 952.833025] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.833025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.833025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.833712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.833712] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.834215] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.835816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.835816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.835816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.835816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.835816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.835816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.835816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.835816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.835816] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.836428] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-50a3b9ca-c1b8-41b7-95bf-c0865270c868 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.836549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.836616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.836769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.836840] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50a3b9ca-c1b8-41b7-95bf-c0865270c868',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.989302] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.989490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.989490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.989669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.989831] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.989927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.989993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.990160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.990246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.990334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.990476] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.990567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.990628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.990764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.990901] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.991013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.991066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.991207] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.991276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.991354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.991442] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.339018] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.340446] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.340446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.340446] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with status ACTIVE [ 953.340663] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.340663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.340744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.340886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.340995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.341191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.341284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.341429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.341517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.341585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.341762] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.341860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.341908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.342109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.342143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.342255] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 is going to be updated. [ 953.367429] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.367429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.367429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.367429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.367429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.367779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.493506] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4339fe92-f605-41dc-aba6-ccecae77b024: rpc.has_security_group_logging(os_id): False [ 953.515861] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.516065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.516173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.516690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.516690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.516828] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.516921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.517019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.517197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.517317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.517548] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.517655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.517824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.517873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.517910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.518153] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.518289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.518289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.518434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.518507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.518592] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 953.608891] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.609927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.609927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.609927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.609927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.625301] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc8d54c1-30b0-4581-9d61-8b194199903c in Status: SUCCESS [ 953.625904] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c deletion is rescheduled due to dependency. [ 953.625904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.630637] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 953.663571] env[66157]: INFO networking_nsxv3.common.synchronization [req-1d155b7c-ada5-43fb-99f5-a723d4121708 req-35681d60-1064-4aee-ba6c-b3d7582aeb64 tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 953.664239] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 953.664594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.664733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.664888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.665117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.665177] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.665257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.665352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.665531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.665673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.665742] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.711623] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 953.711898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.712489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.712803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.713184] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.713336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.713395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.713544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.713625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.713711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.713805] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.844354] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.039862] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.040167] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.040308] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.040629] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.040906] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.041081] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.041200] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.041419] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.041563] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.041766] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.041879] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.042012] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.042134] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.042246] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.042351] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.042478] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.065100] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.065307] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.065397] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.065579] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.065910] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.066109] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.066223] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.066609] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.066727] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d76206a6-ad8e-4ce7-b8c6-5c34b35304a5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.172362] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.216589] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.216589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.216589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.216589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.216589] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.216589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.216925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.216925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.216925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.217042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.217150] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.217240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.217298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.217436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.217567] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.217653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.217710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.217845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.217955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.217997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.218083] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.349346] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.349346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.349346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.349665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.349665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.349772] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 is going to be created. [ 954.378896] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.378896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.378896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.378896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.378896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.387353] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: UNINITIALIZED for 2s [ 954.410865] env[66157]: INFO networking_nsxv3.common.synchronization [req-572ec4a2-4072-40d7-b860-896f1ea4198e req-75f54eb5-db05-4e1d-a1d4-07dbea2a2c8c tempest-ImagesOneServerNegativeTestJSON-417779338 tempest-ImagesOneServerNegativeTestJSON-417779338-project-member] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 954.411935] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 954.412510] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.412604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.412604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.412819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.412977] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.413169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.413229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.413385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.413473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.413570] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.569955] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.570339] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.570496] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.570852] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.571602] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.571602] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port d76206a6-ad8e-4ce7-b8c6-5c34b35304a5 not found, creating... [ 954.571928] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.572176] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.572379] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.572736] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.572901] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.573622] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.573927] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.574110] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.574426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.575485] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.576390] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: d76206a6-ad8e-4ce7-b8c6-5c34b35304a5 is going to be created. [ 954.624543] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.624769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.624894] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.625257] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.625516] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.625749] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.675436] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.721972] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4915dbf-d6e2-46dd-8508-11f50b8da0ef: rpc.has_security_group_logging(os_id): False [ 954.747732] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.747913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.748041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.748267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.789504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.789831] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.789976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.790104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.790341] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.790430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.790678] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.790819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.790869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.791043] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.791118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.791369] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.791480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.791551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.791694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.791762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.791838] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 954.917476] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.917762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.917762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.917942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.922316] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.922446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.943258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.943449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.943449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.943537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.943885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.943885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.943885] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 954.945147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.945147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.947476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.978108] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 955.011383] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.011475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.011512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.011710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.011856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.028275] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 955.177916] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.178148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.178210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.178431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.178521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.178609] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 955.217723] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.217723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.217723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.217980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.218025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.230322] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 955.352219] env[66157]: INFO networking_nsxv3.common.synchronization [req-1d155b7c-ada5-43fb-99f5-a723d4121708 req-447978d7-0414-459b-9911-188c10194aab service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 955.352462] env[66157]: INFO networking_nsxv3.common.synchronization [req-1d155b7c-ada5-43fb-99f5-a723d4121708 req-447978d7-0414-459b-9911-188c10194aab service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 955.353022] env[66157]: INFO networking_nsxv3.common.synchronization [req-1d155b7c-ada5-43fb-99f5-a723d4121708 req-447978d7-0414-459b-9911-188c10194aab service nova] Enqueued Resource ID: d76206a6-ad8e-4ce7-b8c6-5c34b35304a5 with Priority: HIGHEST for action port [ 955.355752] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 955.355752] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 955.355752] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76206a6-ad8e-4ce7-b8c6-5c34b35304a5 with Priority: HIGHEST for action port [ 955.356086] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.356155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.356290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.356796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.357404] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.358594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.358664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.358901] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.358997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.359137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.359301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.359349] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d76206a6-ad8e-4ce7-b8c6-5c34b35304a5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.650083] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 955.650342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.862079] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.862079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.862318] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d76206a6-ad8e-4ce7-b8c6-5c34b35304a5 with status ACTIVE [ 955.862577] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.862577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.862707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.862855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.862946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.863280] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.863387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.863477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.863655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.863736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.863929] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.864091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.864171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.864303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.864378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.864555] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d76206a6-ad8e-4ce7-b8c6-5c34b35304a5 is going to be updated. [ 955.887374] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.887554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.887554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.887754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.887896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.888078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d76206a6-ad8e-4ce7-b8c6-5c34b35304a5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.397884] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: SUCCESS [ 956.398159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.398305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.398529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.398734] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.398849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.398914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.399089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.399406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.399488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.399562] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.902123] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.996506] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 956.997394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.038822] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 957.038822] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 deletion is rescheduled due to dependency. [ 957.038822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.242886] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 957.242886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.243268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.243698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.243805] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.243910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.243910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.244122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.244242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.244360] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.361704] env[66157]: INFO networking_nsxv3.common.synchronization [req-9c3a97ef-f8ee-4666-9b93-7af1b0c6c864 req-b8a2b121-870a-4db7-aa28-fdf8c6ba9451 tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 957.364909] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 957.365377] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.365577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.365686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.365901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.366177] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.366378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.366504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.366779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.366951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.367174] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.404834] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c332a559-4644-4adb-a746-9d19b0df0c73: rpc.has_security_group_logging(os_id): False [ 957.426409] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.426574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.426649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.426924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.427115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.427352] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.427456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.427515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.427682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.427780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.427902] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 is going to be created. [ 957.498089] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.498089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.498089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.498089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.498089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.507552] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: IN_PROGRESS for 2s [ 957.746489] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.765594] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.765594] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.765791] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.766708] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.768886] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.768886] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.768886] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.768886] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.768886] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.768886] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.768886] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.768886] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.768886] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.768886] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.768886] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.768886] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.788537] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.788537] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.788537] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.788772] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.791240] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-ef40a778-85a7-472e-a084-132338277205 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.791240] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-ef40a778-85a7-472e-a084-132338277205" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.791240] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-ef40a778-85a7-472e-a084-132338277205" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.791240] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-ef40a778-85a7-472e-a084-132338277205" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.791240] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef40a778-85a7-472e-a084-132338277205',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.870295] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.870504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.870585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.870823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.892405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.892517] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.892650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.892732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.893092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.893285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.893457] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 957.928289] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.928289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.928449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.928612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.928680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.941264] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 958.248396] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.292798] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.292798] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.292798] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.293373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.293373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.293595] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port ef40a778-85a7-472e-a084-132338277205 not found, creating... [ 958.293980] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.294215] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.294395] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.294700] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.294902] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.295251] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.295418] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.295703] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.296061] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.296232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.296392] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: ef40a778-85a7-472e-a084-132338277205 is going to be created. [ 958.318972] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.319214] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.319342] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.319627] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.319860] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.320106] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-ef40a778-85a7-472e-a084-132338277205" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.751671] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.752017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.752017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.752151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.752253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.752356] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 958.783481] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.783581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.783659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.783925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.784110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.796019] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 959.087586] env[66157]: INFO networking_nsxv3.common.synchronization [req-9c3a97ef-f8ee-4666-9b93-7af1b0c6c864 req-64fe464e-6a04-400f-9ca3-23a5c3e6f69a service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 959.088072] env[66157]: INFO networking_nsxv3.common.synchronization [req-9c3a97ef-f8ee-4666-9b93-7af1b0c6c864 req-64fe464e-6a04-400f-9ca3-23a5c3e6f69a service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 959.088308] env[66157]: INFO networking_nsxv3.common.synchronization [req-9c3a97ef-f8ee-4666-9b93-7af1b0c6c864 req-64fe464e-6a04-400f-9ca3-23a5c3e6f69a service nova] Enqueued Resource ID: ef40a778-85a7-472e-a084-132338277205 with Priority: HIGHEST for action port [ 959.088886] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 959.089130] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 959.089272] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef40a778-85a7-472e-a084-132338277205 with Priority: HIGHEST for action port [ 959.089578] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.089702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.089941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.093629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.093629] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.093629] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.093629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.093629] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef40a778-85a7-472e-a084-132338277205 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.093629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef40a778-85a7-472e-a084-132338277205" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.093629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef40a778-85a7-472e-a084-132338277205" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.093629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef40a778-85a7-472e-a084-132338277205" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.093629] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef40a778-85a7-472e-a084-132338277205',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.523186] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: SUCCESS [ 959.523499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.595477] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.595710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.595864] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef40a778-85a7-472e-a084-132338277205 with status ACTIVE [ 959.596020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.596149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.596188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.596403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.596501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.596687] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.596786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.596871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.597071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.597152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.597406] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.597549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.597600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.597781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.597896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.598043] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef40a778-85a7-472e-a084-132338277205 is going to be updated. [ 959.627414] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.627591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.627748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.627972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.628429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.628429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef40a778-85a7-472e-a084-132338277205" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.954032] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 959.954423] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 959.954423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.954423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.954578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.954922] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.955022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.955058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.955197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.955273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.955373] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.988969] env[66157]: INFO networking_nsxv3.common.synchronization [req-2c3b5349-f9cc-4292-ab0e-f26c892d5225 req-f9ddbebb-2d7a-47de-ace6-c98318eb99b4 tempest-ServerMetadataTestJSON-1534621513 tempest-ServerMetadataTestJSON-1534621513-project-member] Enqueued Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGHEST for action security_group_members [ 959.989565] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGHEST for action security_group_members [ 959.989868] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ccf21c-eeb9-4add-8ed5-296070039162 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.989988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.990634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.990634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.990634] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.990634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.991045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.991045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.991045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.991045] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.429720] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-973 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.430075] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-973" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.430253] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-973" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.430664] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-973" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.430917] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.431176] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.431259] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.431479] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.431697] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.432064] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.432338] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.432477] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.432616] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.432739] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.432844] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.432980] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.453360] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.453559] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 960.453693] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.453871] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-973" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.454198] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-e603cd0e-123d-4081-a864-449dc12af899 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.454515] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-e603cd0e-123d-4081-a864-449dc12af899" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.454515] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-e603cd0e-123d-4081-a864-449dc12af899" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.454815] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-e603cd0e-123d-4081-a864-449dc12af899" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.454947] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e603cd0e-123d-4081-a864-449dc12af899',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.458300] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.495553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.495553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.495553] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ccf21c-eeb9-4add-8ed5-296070039162 already deleted. [ 960.495553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.807708] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 960.807995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.808192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.808406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.808599] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.808722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.808794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.808937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.809023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.809130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.809225] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.957890] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.958174] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.958174] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.958425] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.958574] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.959431] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port e603cd0e-123d-4081-a864-449dc12af899 not found, creating... [ 960.959431] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.959431] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.959431] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.959614] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.959614] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.959960] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.960128] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.960243] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.960479] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.960604] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.960742] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: e603cd0e-123d-4081-a864-449dc12af899 is going to be created. [ 960.962456] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.982155] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.982434] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.982565] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.982830] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.983129] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.983503] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-e603cd0e-123d-4081-a864-449dc12af899" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.312220] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.312424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.312424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.312785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.314543] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.314665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.314722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.315040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.315040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.315145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.315284] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.315656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.315656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.315656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.315796] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.316160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.316160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.316160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.316492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.316492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.316492] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.466105] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.466105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.466105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.466105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.466105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.466414] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 961.502061] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.502259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.502259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.502493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.502685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.512735] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 961.766915] env[66157]: INFO networking_nsxv3.common.synchronization [req-2c3b5349-f9cc-4292-ab0e-f26c892d5225 req-18db4eb6-ae3d-4284-8a77-2aa0c3f5226d service nova] Enqueued Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGHEST for action security_group_rules [ 961.767100] env[66157]: INFO networking_nsxv3.common.synchronization [req-2c3b5349-f9cc-4292-ab0e-f26c892d5225 req-18db4eb6-ae3d-4284-8a77-2aa0c3f5226d service nova] Enqueued Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGHEST for action security_group_members [ 961.767243] env[66157]: INFO networking_nsxv3.common.synchronization [req-2c3b5349-f9cc-4292-ab0e-f26c892d5225 req-18db4eb6-ae3d-4284-8a77-2aa0c3f5226d service nova] Enqueued Resource ID: e603cd0e-123d-4081-a864-449dc12af899 with Priority: HIGHEST for action port [ 961.767785] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGHEST for action security_group_rules [ 961.767940] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGHEST for action security_group_members [ 961.768032] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e603cd0e-123d-4081-a864-449dc12af899 with Priority: HIGHEST for action port [ 961.768310] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5ccf21c-eeb9-4add-8ed5-296070039162 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.768623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.768623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.768767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.768839] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.769703] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ccf21c-eeb9-4add-8ed5-296070039162 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.769821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.769894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.770074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.770220] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.770314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.770379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.770509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.770593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.770684] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.773082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e603cd0e-123d-4081-a864-449dc12af899 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.773082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e603cd0e-123d-4081-a864-449dc12af899" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.773082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e603cd0e-123d-4081-a864-449dc12af899" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.773294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e603cd0e-123d-4081-a864-449dc12af899" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.773712] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e603cd0e-123d-4081-a864-449dc12af899',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.819093] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 961.839149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.839318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.839374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.839682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.860020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.860274] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.860406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.860508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.860724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.860821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.861075] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.861181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.861248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.861425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.861784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.862037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.862155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.862222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.862393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.862505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.862615] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 961.932882] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.933111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.933111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.933408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.933568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.949825] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 962.279422] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e603cd0e-123d-4081-a864-449dc12af899 with status ACTIVE [ 962.279732] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.279803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.279870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.280114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.280205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.280403] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.280535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.280626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.280788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.280865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.281071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.281168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.281230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.281367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.281440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.281523] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e603cd0e-123d-4081-a864-449dc12af899 is going to be updated. [ 962.282702] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.283695] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ccf21c-eeb9-4add-8ed5-296070039162 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.283810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.319118] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.319118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.319118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.319118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.319440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.319440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e603cd0e-123d-4081-a864-449dc12af899" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.785907] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.288828] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.289175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.289175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.289175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.289267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.289462] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ccf21c-eeb9-4add-8ed5-296070039162 is going to be created. [ 963.315141] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.315141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.315141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.315362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.315742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.326538] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ccf21c-eeb9-4add-8ed5-296070039162 in Status: UNINITIALIZED for 2s [ 963.528276] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 963.528511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.528684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.528991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.529274] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.529376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.529411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.531246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.531246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.531246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.531246] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.587949] env[66157]: INFO networking_nsxv3.common.synchronization [req-95b56282-e1e9-4bfc-9e7a-680a0f7e3c55 req-9c919caa-f6e4-4b0b-96ed-cd59b744e55a tempest-MigrationsAdminTest-406320684 tempest-MigrationsAdminTest-406320684-project-member] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 963.588542] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGHEST for action security_group_members [ 963.589116] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.589116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.589116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.589368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.589544] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.589766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.589839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.590038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.590119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.590218] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.963197] env[66157]: INFO networking_nsxv3.common.synchronization [req-0ef30110-74e2-4b12-8d25-d393e9cc2379 req-bfd28ea9-f361-4cf7-a304-1c7cb7ae9890 tempest-ServersAdminTestJSON-1739826864 tempest-ServersAdminTestJSON-1739826864-project-member] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 963.963197] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGHEST for action security_group_members [ 963.963197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.963975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.964402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.965311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.965311] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.965311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.965311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.965311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.965311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.965770] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.967064] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 963.967302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.033876] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.034332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.034441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.034630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.034815] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.034927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.034983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.035133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.035217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.035342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.035476] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.035548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.035664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.036157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.036291] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.036449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.036449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.036576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.036689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.036723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.037021] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.095182] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.095182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.095182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.095182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.116361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.116743] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.116850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.116922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.117137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.117234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.117361] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 is going to be updated. [ 964.144063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.144249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.144295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.144485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.144818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.156744] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: IN_PROGRESS for 2s [ 964.469337] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.469729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.469729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.470041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.491735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.492030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.492159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.492236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.492458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.492509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.492600] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be updated. [ 964.522323] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.522483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.522576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.522821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.523143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.532541] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: IN_PROGRESS for 2s [ 964.539514] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7e2acfe-17af-4683-bd94-9fc47ded2886: rpc.has_security_group_logging(os_id): False [ 964.561243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.561243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.561243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.561243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.561971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.561971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.561971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.562406] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.562406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.562406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.562567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.562567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.562634] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 964.643578] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.643726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.643793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.643994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.644155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.693398] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 965.157813] env[66157]: INFO networking_nsxv3.common.synchronization [req-108048e1-178e-4f75-a690-cb040c79c2bf req-a76e2be8-e570-4625-be9d-9fba509ed8e7 tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 965.158595] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 965.158701] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.159056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.159461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.160054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.160273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.160421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.160534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.160737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.160914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.161092] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.337519] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ccf21c-eeb9-4add-8ed5-296070039162 in Status: SUCCESS [ 965.337968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.338233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.338981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.338981] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.338981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.339194] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.339391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.339500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.339614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.339762] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.664111] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.843803] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ccf21c-eeb9-4add-8ed5-296070039162 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.843982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.844055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.844282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.844445] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.844603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.844657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.844774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.844862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.844951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.845109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ccf21c-eeb9-4add-8ed5-296070039162 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.845203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.845265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.845399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.845533] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.845622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.845688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.845821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.845894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.845974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.846076] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.167674] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.170404] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 in Status: SUCCESS [ 966.171196] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 deletion is rescheduled due to dependency. [ 966.171196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.349384] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5ccf21c-eeb9-4add-8ed5-296070039162: rpc.has_security_group_logging(os_id): False [ 966.368485] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.368485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.368485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.368485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.368485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.368768] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.368768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.368840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.369024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.369230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.369426] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.369760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.369760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.369760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.369935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.370163] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.370163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.371098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.371098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.371098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.371098] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5ccf21c-eeb9-4add-8ed5-296070039162 is going to be created. [ 966.438830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.438992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.439091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.439312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.439558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.458642] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5ccf21c-eeb9-4add-8ed5-296070039162 in Status: IN_PROGRESS for 2s [ 966.545700] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 222383c0-b19b-4725-af40-286f27465c68 in Status: SUCCESS [ 966.546176] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 222383c0-b19b-4725-af40-286f27465c68 deletion is rescheduled due to dependency. [ 966.546383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.670390] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.671205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.671205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.671808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.671967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.672135] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 966.703683] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.703891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.703946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.704131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.704378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.706597] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 966.706792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.712605] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 968.471155] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5ccf21c-eeb9-4add-8ed5-296070039162 in Status: SUCCESS [ 968.471428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.523804] env[66157]: INFO networking_nsxv3.common.synchronization [req-763453f5-00e8-42a1-b162-6de2f7106aab req-c4de83d8-08f3-4037-9704-143a4b72174e tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 968.524388] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 968.524731] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.524901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.524901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.530070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.530070] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.530070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.530070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.530070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.530070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.530070] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.724189] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 968.724488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.922270] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.923115] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.923115] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.923359] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.923854] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.927018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.927018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.927018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.927018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.927018] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.927018] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.927018] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.927018] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.927018] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.927018] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.927018] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.946825] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.947065] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.947133] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.947305] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.947673] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-235f9f3f-cd08-4b82-889c-4b9354795502 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.947885] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-235f9f3f-cd08-4b82-889c-4b9354795502" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.947957] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-235f9f3f-cd08-4b82-889c-4b9354795502" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.948316] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-235f9f3f-cd08-4b82-889c-4b9354795502" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.948452] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('235f9f3f-cd08-4b82-889c-4b9354795502',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.031951] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.032183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.032256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.032421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.052449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.052701] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.052821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.052888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.053110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.053192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.053281] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 969.082181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.082181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.082181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.082452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.082671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.105522] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 969.451833] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.452091] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.452227] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.452508] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.452871] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.454189] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 235f9f3f-cd08-4b82-889c-4b9354795502 not found, creating... [ 969.454541] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.454768] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.454929] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.455208] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.455361] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.455679] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.455845] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.455968] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.456210] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.456349] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.456493] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 235f9f3f-cd08-4b82-889c-4b9354795502 is going to be created. [ 969.481794] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.482184] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.482184] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.482401] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.482629] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.482852] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-235f9f3f-cd08-4b82-889c-4b9354795502" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.102213] env[66157]: INFO networking_nsxv3.common.synchronization [req-d51a2709-6a87-498d-9546-f3e3aa888e14 req-2339d69b-b919-4f4b-96f1-c03ce0f31128 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 970.102213] env[66157]: INFO networking_nsxv3.common.synchronization [req-d51a2709-6a87-498d-9546-f3e3aa888e14 req-2339d69b-b919-4f4b-96f1-c03ce0f31128 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 970.102213] env[66157]: INFO networking_nsxv3.common.synchronization [req-d51a2709-6a87-498d-9546-f3e3aa888e14 req-2339d69b-b919-4f4b-96f1-c03ce0f31128 tempest-SecurityGroupsTestJSON-844353641 tempest-SecurityGroupsTestJSON-844353641-project-member] Enqueued Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGHEST for action security_group_members [ 970.102213] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGHEST for action security_group_members [ 970.102398] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGHEST for action security_group_members [ 970.102530] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGHEST for action security_group_members [ 970.102842] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.102961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.103028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.103228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.103375] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.103473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.103534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.103727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.103827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.103925] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.104974] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.105110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.105176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.105334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.105472] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.105564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.105623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.105763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.105843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.105934] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.106842] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-58626db2-1bef-478d-8fe6-5cb88f964fa3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.106983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.107092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.107267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.107477] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.107549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.107622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.107932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.107932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.108036] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.198343] env[66157]: INFO networking_nsxv3.common.synchronization [req-763453f5-00e8-42a1-b162-6de2f7106aab req-7e21b3cd-953d-4ca0-b9d9-862cfe5c4cb7 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 970.198478] env[66157]: INFO networking_nsxv3.common.synchronization [req-763453f5-00e8-42a1-b162-6de2f7106aab req-7e21b3cd-953d-4ca0-b9d9-862cfe5c4cb7 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 970.198613] env[66157]: INFO networking_nsxv3.common.synchronization [req-763453f5-00e8-42a1-b162-6de2f7106aab req-7e21b3cd-953d-4ca0-b9d9-862cfe5c4cb7 service nova] Enqueued Resource ID: 235f9f3f-cd08-4b82-889c-4b9354795502 with Priority: HIGHEST for action port [ 970.199258] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 970.200343] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 970.200542] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 235f9f3f-cd08-4b82-889c-4b9354795502 with Priority: HIGHEST for action port [ 970.200923] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.201130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.201242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.201454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.201577] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.202596] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.202691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.203551] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-235f9f3f-cd08-4b82-889c-4b9354795502 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.203551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-235f9f3f-cd08-4b82-889c-4b9354795502" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.203551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-235f9f3f-cd08-4b82-889c-4b9354795502" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.203551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-235f9f3f-cd08-4b82-889c-4b9354795502" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.203551] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('235f9f3f-cd08-4b82-889c-4b9354795502',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.610490] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.610490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.610490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.611539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.611862] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.611971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.612232] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.612312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.633522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.633747] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.633902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.633965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.634163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.634241] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.634405] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba is going to be updated. [ 970.635304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.635467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.635722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.635760] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.635845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.635894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.636381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.636381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.636381] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be updated. [ 970.637091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.637259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.655868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.656226] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.656359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.656411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.656621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.656835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.656835] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 is going to be updated. [ 970.675607] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.675779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.675824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.676066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.676257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.679064] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.679239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.679321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.679550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.679705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.691266] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: IN_PROGRESS for 2s [ 970.691991] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: IN_PROGRESS for 2s [ 970.695082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.695231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.695293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.695536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.695666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.705129] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 in Status: IN_PROGRESS for 2s [ 970.705594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.705742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.705944] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 235f9f3f-cd08-4b82-889c-4b9354795502 with status ACTIVE [ 970.706103] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.706220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.706287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.706493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.706577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.706761] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.706872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.706938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.707030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.707108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.707286] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.707376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.707436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.707882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.707882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.707882] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 235f9f3f-cd08-4b82-889c-4b9354795502 is going to be updated. [ 970.734962] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.735244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.735244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.735585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.735585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.735721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-235f9f3f-cd08-4b82-889c-4b9354795502" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.118389] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 971.120576] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 971.120667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.120861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.121120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.121313] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.121425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.121537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.121680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.121781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.121993] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.252927] env[66157]: INFO networking_nsxv3.common.synchronization [None req-e1044165-938d-4413-bef3-4c42d46febc7 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_rules [ 971.253484] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_rules [ 971.253834] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ed4675f-1916-4e79-b525-fb7797e97825 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.253957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.258349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.258349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.258349] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.359194] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f26d8c2e-3393-4a3e-8498-ed129189bca7 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_rules [ 971.359859] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_rules [ 971.360235] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ed4675f-1916-4e79-b525-fb7797e97825 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.360355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.625804] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.783646] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.783803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.783850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.784703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.784703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.784703] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ed4675f-1916-4e79-b525-fb7797e97825 already deleted. [ 971.784703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.784703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.784703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.784703] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.131601] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.328016] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.328189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.328265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.328494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.328586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.328691] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ed4675f-1916-4e79-b525-fb7797e97825 already deleted. [ 972.328775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.635332] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.635332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.635332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.635332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.635332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.635332] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 972.668934] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.669117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.669374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.669463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.669611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.682173] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 972.701279] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba in Status: SUCCESS [ 972.701468] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba deletion is rescheduled due to dependency. [ 972.701584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.702373] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4339fe92-f605-41dc-aba6-ccecae77b024 in Status: SUCCESS [ 972.702552] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 deletion is rescheduled due to dependency. [ 972.702653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.730615] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 in Status: SUCCESS [ 972.730837] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 deletion is rescheduled due to dependency. [ 972.730954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.932430] env[66157]: INFO networking_nsxv3.common.synchronization [None req-70235e27-c1b1-41fe-9f28-1e9fcb8129e2 tempest-ImagesOneServerNegativeTestJSON-417779338 tempest-ImagesOneServerNegativeTestJSON-417779338-project-member] Enqueued Resource ID: 00513a3a-f29c-4953-a82a-0db489f7a86a with Priority: HIGHEST for action security_group_rules [ 973.932798] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00513a3a-f29c-4953-a82a-0db489f7a86a with Priority: HIGHEST for action security_group_rules [ 973.933552] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00513a3a-f29c-4953-a82a-0db489f7a86a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.933552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00513a3a-f29c-4953-a82a-0db489f7a86a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.933552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00513a3a-f29c-4953-a82a-0db489f7a86a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.933552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00513a3a-f29c-4953-a82a-0db489f7a86a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.933958] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00513a3a-f29c-4953-a82a-0db489f7a86a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.022019] env[66157]: INFO networking_nsxv3.common.synchronization [None req-ad99d28d-0cdd-49aa-ae65-095656b4f000 tempest-ImagesOneServerNegativeTestJSON-417779338 tempest-ImagesOneServerNegativeTestJSON-417779338-project-member] Enqueued Resource ID: 00513a3a-f29c-4953-a82a-0db489f7a86a with Priority: HIGHEST for action security_group_rules [ 974.022273] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00513a3a-f29c-4953-a82a-0db489f7a86a with Priority: HIGHEST for action security_group_rules [ 974.022501] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00513a3a-f29c-4953-a82a-0db489f7a86a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.022604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00513a3a-f29c-4953-a82a-0db489f7a86a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.217346] env[66157]: INFO networking_nsxv3.common.synchronization [req-6d77124b-f0ef-4a56-bb70-b7ae536d976f req-673f44fb-9df2-4333-b16c-0c84140543a8 tempest-ServerMetadataTestJSON-1534621513 tempest-ServerMetadataTestJSON-1534621513-project-member] Enqueued Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGHEST for action security_group_members [ 974.217346] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGHEST for action security_group_members [ 974.219922] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ccf21c-eeb9-4add-8ed5-296070039162 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.220101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.220197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.220427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.220610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.220741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.220830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.221153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.221278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.221626] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.454961] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.455503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.455503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.455503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.455503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.455642] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00513a3a-f29c-4953-a82a-0db489f7a86a already deleted. [ 974.455642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00513a3a-f29c-4953-a82a-0db489f7a86a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.455807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00513a3a-f29c-4953-a82a-0db489f7a86a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.455955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00513a3a-f29c-4953-a82a-0db489f7a86a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.456050] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00513a3a-f29c-4953-a82a-0db489f7a86a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.694496] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 974.694842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.695207] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.695675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.695894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.696135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.696258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.696545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.696769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.696854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.697084] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.723584] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.723754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.723792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.724038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.724138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.724337] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.724433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.724836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.724836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.724836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.724836] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ccf21c-eeb9-4add-8ed5-296070039162 is going to be updated. [ 974.774068] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.774251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.774312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.774537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.774694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.786902] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ccf21c-eeb9-4add-8ed5-296070039162 in Status: IN_PROGRESS for 2s [ 974.982512] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.982781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.982819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.983120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.983223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.983319] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00513a3a-f29c-4953-a82a-0db489f7a86a already deleted. [ 974.983423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00513a3a-f29c-4953-a82a-0db489f7a86a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.199939] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.200137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.200202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.200428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.200602] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.200704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.200767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.200919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.201016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.201111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.201258] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.201425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.201425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.201559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.201694] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.201786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.201872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.202038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.202126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.202208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.202317] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.704751] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94: rpc.has_security_group_logging(os_id): False [ 975.732181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.732181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.732181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.732181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.732181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.732181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.732181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.732181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.732181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.732181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.732181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.732797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.732797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.732797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.732797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.732797] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.732797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.732997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.733254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.733334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.733386] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 975.802402] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.803138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.803138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.803138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.803300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.816662] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 976.798375] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ccf21c-eeb9-4add-8ed5-296070039162 in Status: SUCCESS [ 976.798375] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ccf21c-eeb9-4add-8ed5-296070039162 deletion is rescheduled due to dependency. [ 976.798375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.832591] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 977.832945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.220043] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 979.220043] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 980.185498] env[66157]: INFO networking_nsxv3.common.synchronization [req-75c08d1e-c404-4e55-95fd-8441821314f7 req-6b016992-ffda-418c-9b96-6907c37ca31e tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 980.186098] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 980.186489] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.186661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.186763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.186954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.187131] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.187230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.187300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.187441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.187601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.187679] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.689293] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.720298] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.720584] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.720713] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.720976] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.721270] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.721426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.721542] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.721757] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.721904] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.724235] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.724390] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.724501] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.724612] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.724728] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.724833] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.724964] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.747841] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.748077] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.748272] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.748531] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.748976] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-cfd02dd2-1bd1-4e94-9377-7a84f1468053 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.749255] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-cfd02dd2-1bd1-4e94-9377-7a84f1468053" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.749442] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-cfd02dd2-1bd1-4e94-9377-7a84f1468053" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.749884] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-cfd02dd2-1bd1-4e94-9377-7a84f1468053" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.750097] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd02dd2-1bd1-4e94-9377-7a84f1468053',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.193104] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.253763] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.253928] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.253988] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.255842] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.255842] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.255842] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port cfd02dd2-1bd1-4e94-9377-7a84f1468053 not found, creating... [ 981.255842] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.255842] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.255842] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.255842] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.255842] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.255842] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.256258] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.256258] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.256316] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.256436] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.256569] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: cfd02dd2-1bd1-4e94-9377-7a84f1468053 is going to be created. [ 981.277445] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.277445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.277445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.277445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.277445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.277752] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-cfd02dd2-1bd1-4e94-9377-7a84f1468053" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.697147] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.697683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.697683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.697683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.697683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.697893] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 981.728940] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.729110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.729209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.729386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.729783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.738473] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 981.784516] env[66157]: INFO networking_nsxv3.common.synchronization [None req-30cee385-e4d2-4f64-92e7-cd4c858011d4 None None] Enqueued Resource ID: 6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0 with Priority: HIGHEST for action port [ 981.784516] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0 with Priority: HIGHEST for action port [ 981.784516] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.784516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.784516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.784516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.784516] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.025926] env[66157]: INFO networking_nsxv3.common.synchronization [req-75c08d1e-c404-4e55-95fd-8441821314f7 req-ce813b6c-b68a-43f6-a692-3a5203b1bff6 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 982.026138] env[66157]: INFO networking_nsxv3.common.synchronization [req-75c08d1e-c404-4e55-95fd-8441821314f7 req-ce813b6c-b68a-43f6-a692-3a5203b1bff6 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 982.026311] env[66157]: INFO networking_nsxv3.common.synchronization [req-75c08d1e-c404-4e55-95fd-8441821314f7 req-ce813b6c-b68a-43f6-a692-3a5203b1bff6 service nova] Enqueued Resource ID: cfd02dd2-1bd1-4e94-9377-7a84f1468053 with Priority: HIGHEST for action port [ 982.026804] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 982.027142] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 982.033020] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfd02dd2-1bd1-4e94-9377-7a84f1468053 with Priority: HIGHEST for action port [ 982.033020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.033020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.033020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.033020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.033020] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.033020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.033020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.033020] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfd02dd2-1bd1-4e94-9377-7a84f1468053 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.033020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfd02dd2-1bd1-4e94-9377-7a84f1468053" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.033020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfd02dd2-1bd1-4e94-9377-7a84f1468053" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.033020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfd02dd2-1bd1-4e94-9377-7a84f1468053" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.033020] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd02dd2-1bd1-4e94-9377-7a84f1468053',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.281199] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0 [ 982.281462] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.281640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.281716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.281931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.282033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.282131] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0 already deleted. [ 982.282225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb0dbf9-5c4a-4571-942a-09c7cf67cbf0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.537505] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfd02dd2-1bd1-4e94-9377-7a84f1468053 with status ACTIVE [ 982.537505] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.537505] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.537505] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.537505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.537993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.537993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.537993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.537993] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfd02dd2-1bd1-4e94-9377-7a84f1468053 is going to be updated. [ 982.538956] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.539512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.562523] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.563471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.563471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.563471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.563471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.563471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfd02dd2-1bd1-4e94-9377-7a84f1468053" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.750446] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 983.750714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.750911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.751172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.751383] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.751510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.751577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.751757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.751853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.751959] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.030095] env[66157]: INFO networking_nsxv3.common.synchronization [None req-68b14082-4a52-4abf-85ef-e7d228dae168 None None] Enqueued Resource ID: a24421c4-a577-4eb3-9bb0-eb4d96461181 with Priority: HIGHEST for action port [ 984.030095] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a24421c4-a577-4eb3-9bb0-eb4d96461181 with Priority: HIGHEST for action port [ 984.030095] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a24421c4-a577-4eb3-9bb0-eb4d96461181 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.030095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a24421c4-a577-4eb3-9bb0-eb4d96461181" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.030095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a24421c4-a577-4eb3-9bb0-eb4d96461181" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.030095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a24421c4-a577-4eb3-9bb0-eb4d96461181" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.031162] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a24421c4-a577-4eb3-9bb0-eb4d96461181',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.254172] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.515152] env[66157]: INFO networking_nsxv3.common.synchronization [None req-509a1c15-194d-48fc-9f0c-51e1b4ade732 None None] Enqueued Resource ID: cc868d2d-240b-4598-980a-8bce8db71e99 with Priority: HIGHEST for action port [ 984.515781] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc868d2d-240b-4598-980a-8bce8db71e99 with Priority: HIGHEST for action port [ 984.515919] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc868d2d-240b-4598-980a-8bce8db71e99 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.515987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc868d2d-240b-4598-980a-8bce8db71e99" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.516044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc868d2d-240b-4598-980a-8bce8db71e99" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.516497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc868d2d-240b-4598-980a-8bce8db71e99" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.516497] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc868d2d-240b-4598-980a-8bce8db71e99',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.534923] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a24421c4-a577-4eb3-9bb0-eb4d96461181 [ 984.535163] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.535313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.535417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.535670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.535948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.535948] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a24421c4-a577-4eb3-9bb0-eb4d96461181 already deleted. [ 984.535948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a24421c4-a577-4eb3-9bb0-eb4d96461181" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.658624] env[66157]: INFO networking_nsxv3.common.synchronization [req-36fb2db3-a10d-42f0-8809-e1c6d5b63b20 req-38767223-8e1b-49f5-91cb-aaa963a05b60 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 984.659238] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 984.659464] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.659847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.659847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.660019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.660061] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.660681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.660681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.660785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.660826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.660974] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.759829] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.018503] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc868d2d-240b-4598-980a-8bce8db71e99 [ 985.018984] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.019081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.019332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.019467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.019683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.019800] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc868d2d-240b-4598-980a-8bce8db71e99 already deleted. [ 985.019953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc868d2d-240b-4598-980a-8bce8db71e99" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.161494] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.161720] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.161810] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.162165] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.162491] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.162656] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.162772] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.163014] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.163181] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.163645] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.163645] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.163645] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.163876] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.163876] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.163986] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.164059] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.166676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.166676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.166676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.166676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.166676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.166676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.166676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.166676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.167664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.167664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.167664] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 already deleted. [ 985.167878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.190607] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.190784] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.190942] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.191150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.191475] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-e9493584-2a21-4fa1-845e-05bcec5c1102 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.191691] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-e9493584-2a21-4fa1-845e-05bcec5c1102" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.191814] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-e9493584-2a21-4fa1-845e-05bcec5c1102" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.192181] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-e9493584-2a21-4fa1-845e-05bcec5c1102" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.192319] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9493584-2a21-4fa1-845e-05bcec5c1102',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.262300] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.262585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.262720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.263045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.263216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.263386] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 985.295263] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.295489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.295589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.295835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.296054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.306460] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 985.695499] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.695819] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.695962] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.696321] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.697600] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.697969] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port e9493584-2a21-4fa1-845e-05bcec5c1102 not found, creating... [ 985.698129] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.698303] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.698426] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.698676] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.698845] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.701095] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.701556] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.701556] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.701692] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.701871] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.701992] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: e9493584-2a21-4fa1-845e-05bcec5c1102 is going to be created. [ 985.726669] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.726997] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.727277] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.727626] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.727886] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.728242] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-e9493584-2a21-4fa1-845e-05bcec5c1102" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.442035] env[66157]: INFO networking_nsxv3.common.synchronization [req-36fb2db3-a10d-42f0-8809-e1c6d5b63b20 req-5a0a0c13-cd41-4c6f-b563-58690bd7fe1e service nova] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_rules [ 986.442035] env[66157]: INFO networking_nsxv3.common.synchronization [req-36fb2db3-a10d-42f0-8809-e1c6d5b63b20 req-5a0a0c13-cd41-4c6f-b563-58690bd7fe1e service nova] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 986.442035] env[66157]: INFO networking_nsxv3.common.synchronization [req-36fb2db3-a10d-42f0-8809-e1c6d5b63b20 req-5a0a0c13-cd41-4c6f-b563-58690bd7fe1e service nova] Enqueued Resource ID: e9493584-2a21-4fa1-845e-05bcec5c1102 with Priority: HIGHEST for action port [ 986.442820] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_rules [ 986.443073] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 986.446128] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9493584-2a21-4fa1-845e-05bcec5c1102 with Priority: HIGHEST for action port [ 986.446128] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.446128] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.446128] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.446128] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.446128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.447221] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.448755] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9493584-2a21-4fa1-845e-05bcec5c1102 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.449088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9493584-2a21-4fa1-845e-05bcec5c1102" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.449310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9493584-2a21-4fa1-845e-05bcec5c1102" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.450322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9493584-2a21-4fa1-845e-05bcec5c1102" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.450322] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9493584-2a21-4fa1-845e-05bcec5c1102',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.613982] env[66157]: INFO networking_nsxv3.common.synchronization [req-b33b7f2e-8d5d-483d-8992-37e474d4b106 req-b5571dcb-6503-4e03-9a96-c53d1c1de742 tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 986.614408] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 986.614914] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.614914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.614914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.615213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.615607] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.615922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.615922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.616054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.616140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.616249] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.951630] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.951765] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.951977] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.952939] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9493584-2a21-4fa1-845e-05bcec5c1102 with status ACTIVE [ 986.953140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.953249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.953466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.953536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.953608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.953828] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.953888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.953921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.954077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.954464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.954464] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.954560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.954614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.954758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.954901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.954901] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9493584-2a21-4fa1-845e-05bcec5c1102 is going to be updated. [ 986.978160] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.978328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.978457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.978677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.978820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.978984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9493584-2a21-4fa1-845e-05bcec5c1102" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.118718] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.118900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.118978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.119234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.119327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.119539] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.119641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.119700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.119846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.119920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.120015] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 987.172890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.173169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.173260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.173988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.173988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.184192] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 987.324371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 987.324733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.324915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.325169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.325383] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.325536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.325601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.325771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.325850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.325961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.326064] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.457607] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.828730] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.828932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.829014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.829251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.829423] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.829527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.829591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.829739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.829822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.829908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.830093] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.830170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.830260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.830468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.830611] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.830702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.830761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.831234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.831377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.831954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.831954] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.959723] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.959901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.959946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.960872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.960872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.960872] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be created. [ 987.983695] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.983872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.983928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.984179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.984329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.993541] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: UNINITIALIZED for 2s [ 988.207854] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0cbca58d-075e-4b35-bc44-c576976a923f None None] Enqueued Resource ID: a2ef42fb-e49a-4762-9633-356aabfcea0f with Priority: HIGHEST for action port [ 988.208111] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ef42fb-e49a-4762-9633-356aabfcea0f with Priority: HIGHEST for action port [ 988.208681] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ef42fb-e49a-4762-9633-356aabfcea0f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.208800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ef42fb-e49a-4762-9633-356aabfcea0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.208867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ef42fb-e49a-4762-9633-356aabfcea0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.209189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ef42fb-e49a-4762-9633-356aabfcea0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.209298] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ef42fb-e49a-4762-9633-356aabfcea0f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.334612] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 988.354529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.354529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.354529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.354529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.354529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.354529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.354529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.354529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.354910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.354910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.354968] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.355553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.355553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.355553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.355553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.355553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.355816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.355816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.355816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.355921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.355921] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 988.426616] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.426767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.427133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.427133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.427291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.443109] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 988.711364] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2ef42fb-e49a-4762-9633-356aabfcea0f [ 988.711728] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.711861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.711861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.712066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.712158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.712254] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2ef42fb-e49a-4762-9633-356aabfcea0f already deleted. [ 988.712335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ef42fb-e49a-4762-9633-356aabfcea0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.196043] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 989.196231] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef deletion is rescheduled due to dependency. [ 989.196272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.009591] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: SUCCESS [ 990.009957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.010413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.010685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.010823] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.010940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.011015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.011172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.011255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.011340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.011431] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.460670] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 990.460970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.514731] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.515036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.515036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.515222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.515391] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.515489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.515554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.515711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.515799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.515887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.516041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.516132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.516188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.516324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.516456] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.516543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.516602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.516730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.516802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.516879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.516966] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.023824] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6a87886-c2f5-4505-92ee-9c2a202b7b93: rpc.has_security_group_logging(os_id): False [ 991.045261] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.045411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.045481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.045697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.045803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.046142] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.046249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.046348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.046593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.046593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.046812] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.046926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.046992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.047356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.047434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.047791] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.047960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.048148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.048338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.048441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.048556] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be created. [ 991.129273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.129511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.129511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.129814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.129949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.143676] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: IN_PROGRESS for 2s [ 992.912064] env[66157]: INFO networking_nsxv3.common.synchronization [req-2407cb06-f6d8-405b-b064-3487b04902f0 req-1fc7228e-4b99-4248-9992-0cc00fbc9d52 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_members [ 992.912639] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_members [ 992.912978] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed4675f-1916-4e79-b525-fb7797e97825 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.914520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.914520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.914520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.915315] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.916416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.916416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.916416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.916416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.916416] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.162247] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: SUCCESS [ 993.163216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.336885] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-869 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.337084] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.337259] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.337575] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.337865] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.338106] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.338244] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.338490] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.338654] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.338894] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.339027] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.339153] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.339265] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.339391] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.339513] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.339663] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.361204] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.361204] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.361414] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.361644] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.362045] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-64debcc3-e14c-482c-bb7a-d67af59faf33 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.362240] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-64debcc3-e14c-482c-bb7a-d67af59faf33" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.362506] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-64debcc3-e14c-482c-bb7a-d67af59faf33" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.362762] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-64debcc3-e14c-482c-bb7a-d67af59faf33" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.362930] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64debcc3-e14c-482c-bb7a-d67af59faf33',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.422609] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.422816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.423165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.423165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.423463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.423463] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.423587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.423587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.423737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.423792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.423898] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ed4675f-1916-4e79-b525-fb7797e97825 already deleted. [ 993.423978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.866155] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.866392] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.866512] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.866798] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.866942] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.867206] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 64debcc3-e14c-482c-bb7a-d67af59faf33 not found, creating... [ 993.867478] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.867638] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.867752] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.867984] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.868139] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.868428] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.868587] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.868693] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.868903] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.869041] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.869191] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 64debcc3-e14c-482c-bb7a-d67af59faf33 is going to be created. [ 993.889294] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.889529] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.889639] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.889942] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.890206] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.890419] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-64debcc3-e14c-482c-bb7a-d67af59faf33" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.588519] env[66157]: INFO networking_nsxv3.common.synchronization [req-2407cb06-f6d8-405b-b064-3487b04902f0 req-e686cd76-0d9e-443d-b220-279efdb54607 service nova] Enqueued Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_rules [ 994.588811] env[66157]: INFO networking_nsxv3.common.synchronization [req-2407cb06-f6d8-405b-b064-3487b04902f0 req-e686cd76-0d9e-443d-b220-279efdb54607 service nova] Enqueued Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_members [ 994.588893] env[66157]: INFO networking_nsxv3.common.synchronization [req-2407cb06-f6d8-405b-b064-3487b04902f0 req-e686cd76-0d9e-443d-b220-279efdb54607 service nova] Enqueued Resource ID: 64debcc3-e14c-482c-bb7a-d67af59faf33 with Priority: HIGHEST for action port [ 994.589461] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_rules [ 994.589618] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_members [ 994.589988] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64debcc3-e14c-482c-bb7a-d67af59faf33 with Priority: HIGHEST for action port [ 994.590504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ed4675f-1916-4e79-b525-fb7797e97825 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.590631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.590700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.590903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.590988] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.593066] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed4675f-1916-4e79-b525-fb7797e97825 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.597822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.597822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.597822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.597822] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.597822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.597822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.597822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.597822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.597822] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.598213] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-64debcc3-e14c-482c-bb7a-d67af59faf33 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.598282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64debcc3-e14c-482c-bb7a-d67af59faf33" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.598819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64debcc3-e14c-482c-bb7a-d67af59faf33" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.598819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64debcc3-e14c-482c-bb7a-d67af59faf33" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.598819] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64debcc3-e14c-482c-bb7a-d67af59faf33',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.763272] env[66157]: INFO networking_nsxv3.common.synchronization [None req-17337203-5620-4a5d-a186-ca73e7d450b8 None None] Enqueued Resource ID: b07ec78e-d502-415a-8099-90ed88a8a0b0 with Priority: HIGHEST for action port [ 994.763816] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07ec78e-d502-415a-8099-90ed88a8a0b0 with Priority: HIGHEST for action port [ 994.764162] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b07ec78e-d502-415a-8099-90ed88a8a0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.764288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b07ec78e-d502-415a-8099-90ed88a8a0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.764356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b07ec78e-d502-415a-8099-90ed88a8a0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.764614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b07ec78e-d502-415a-8099-90ed88a8a0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.764697] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b07ec78e-d502-415a-8099-90ed88a8a0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.892303] env[66157]: INFO networking_nsxv3.common.synchronization [req-64ee592f-e901-435b-884a-eaa443d1ebb8 req-739b4f03-2f73-42a0-89ee-3ab4dd9ab21c tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 994.893496] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 994.893496] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.893496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.893496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.893709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.893741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.893833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.893884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.894018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.894173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.894269] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.094396] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed4675f-1916-4e79-b525-fb7797e97825 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.094595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.105046] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.105046] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64debcc3-e14c-482c-bb7a-d67af59faf33 with status ACTIVE [ 995.105046] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.105046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.105046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.106552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.106552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.106810] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.106931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.107811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.107811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.107943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.108554] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.108554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.108678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.108855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.108961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.109061] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64debcc3-e14c-482c-bb7a-d67af59faf33 is going to be updated. [ 995.133557] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.133704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.133776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.133988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.134143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.134308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64debcc3-e14c-482c-bb7a-d67af59faf33" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.268117] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b07ec78e-d502-415a-8099-90ed88a8a0b0 [ 995.268385] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.268453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.268522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.268752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.268840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.268935] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b07ec78e-d502-415a-8099-90ed88a8a0b0 already deleted. [ 995.269023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b07ec78e-d502-415a-8099-90ed88a8a0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.330255] env[66157]: INFO networking_nsxv3.common.synchronization [req-2c3b29b4-19dc-406c-bc90-fcdc97c24317 req-5ccf37de-c90a-488f-bded-9d3000674fdb tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 995.330381] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 995.330709] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.331840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.331840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.331840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.331840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.331840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.331840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.331840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.332125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.332184] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.400830] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.611418] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.835556] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.835808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.835891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.836108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.836266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.836447] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.836570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.836618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.836783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.836977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.836977] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 995.869426] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.869426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.869426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.869687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.869878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.878994] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 995.901864] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.117057] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.118690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.118690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.118690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.118690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.118690] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ed4675f-1916-4e79-b525-fb7797e97825 is going to be created. [ 996.147080] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.147273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.147347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.147571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.147720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.159821] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ed4675f-1916-4e79-b525-fb7797e97825 in Status: UNINITIALIZED for 2s [ 996.404764] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.404764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.404764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.408029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.408029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.408029] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 996.441610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.441814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.441814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.442102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.442268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.453206] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 997.523776] env[66157]: INFO networking_nsxv3.common.synchronization [None req-152bee90-2b9e-4362-af25-fbd918ccd25a None None] Enqueued Resource ID: 52e6cb78-3696-43c5-9d90-e72a52fb34e5 with Priority: HIGHEST for action port [ 997.523776] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52e6cb78-3696-43c5-9d90-e72a52fb34e5 with Priority: HIGHEST for action port [ 997.523776] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-52e6cb78-3696-43c5-9d90-e72a52fb34e5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.523776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52e6cb78-3696-43c5-9d90-e72a52fb34e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.523776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52e6cb78-3696-43c5-9d90-e72a52fb34e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.523776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52e6cb78-3696-43c5-9d90-e72a52fb34e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.523776] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52e6cb78-3696-43c5-9d90-e72a52fb34e5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.759346] env[66157]: INFO networking_nsxv3.common.synchronization [req-d0f0b90e-753a-420d-974a-b0f181e50510 req-42d4c8f5-ea2d-4196-8c6c-d93517b5ced7 tempest-ImagesOneServerNegativeTestJSON-417779338 tempest-ImagesOneServerNegativeTestJSON-417779338-project-member] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 997.759904] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 997.760258] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.760403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.760470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.760666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.760820] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.760921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.764930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.764930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.764930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.764930] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.890921] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 997.891276] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 997.891966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.025638] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52e6cb78-3696-43c5-9d90-e72a52fb34e5 [ 998.025841] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.026426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.026426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.026601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.026601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.026703] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52e6cb78-3696-43c5-9d90-e72a52fb34e5 already deleted. [ 998.026703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52e6cb78-3696-43c5-9d90-e72a52fb34e5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.171222] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ed4675f-1916-4e79-b525-fb7797e97825 in Status: SUCCESS [ 998.171850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.171850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.174014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.174014] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.174014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.174014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.174014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.174014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.174014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.174014] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.248973] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.249240] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.249393] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.249664] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.249933] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.250095] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.250208] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.250410] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.250545] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.250744] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.252532] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.252532] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.252532] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.252532] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.252532] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.252532] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.267291] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.267464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.267526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.267713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.267811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.268049] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.268164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.268232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.268377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.268455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.268540] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 998.271796] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.271973] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 998.272153] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.272333] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.272627] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-6a04a06f-d4f9-4534-a623-cd976fd57c46 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.272826] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-6a04a06f-d4f9-4534-a623-cd976fd57c46" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.272919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-6a04a06f-d4f9-4534-a623-cd976fd57c46" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.273240] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-6a04a06f-d4f9-4534-a623-cd976fd57c46" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.273403] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a04a06f-d4f9-4534-a623-cd976fd57c46',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.297415] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.297415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.297605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.297674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.297868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.308283] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 998.337902] env[66157]: INFO networking_nsxv3.common.synchronization [req-8dafc814-38b8-49da-ba47-452c49f4dffa req-7976d866-62f8-45d1-9174-f91606add7f0 tempest-ServersV294TestFqdnHostnames-725788328 tempest-ServersV294TestFqdnHostnames-725788328-project-member] Enqueued Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_members [ 998.338420] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGHEST for action security_group_members [ 998.338719] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.338835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.338900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.339103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.339250] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.339414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.339414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.339636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.339636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.339693] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.463999] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 998.464298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.678499] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.776406] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.776701] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.776808] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.777108] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.777273] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.777483] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 6a04a06f-d4f9-4534-a623-cd976fd57c46 not found, creating... [ 998.777821] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.778023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.778165] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.778448] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.778648] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.778984] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.779189] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.779382] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.779735] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.779798] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.779963] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 6a04a06f-d4f9-4534-a623-cd976fd57c46 is going to be created. [ 998.803724] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.803991] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.804148] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.804463] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.804697] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.804988] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-6a04a06f-d4f9-4534-a623-cd976fd57c46" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.841724] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.841920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.841985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.842324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.866695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.866970] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.867106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.867171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.867424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.867517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.867610] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 is going to be updated. [ 998.917442] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.917442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.917442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.917442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.917442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.936875] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 in Status: IN_PROGRESS for 2s [ 999.181084] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ed4675f-1916-4e79-b525-fb7797e97825: rpc.has_security_group_logging(os_id): False [ 999.198521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.198695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.198852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.198941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.200830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.200830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.200830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.200830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.200830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.200830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.200830] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ed4675f-1916-4e79-b525-fb7797e97825 is going to be created. [ 999.261402] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.261402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.261402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.261402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.261402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.275126] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ed4675f-1916-4e79-b525-fb7797e97825 in Status: IN_PROGRESS for 2s [ 999.508647] env[66157]: INFO networking_nsxv3.common.synchronization [req-d0f0b90e-753a-420d-974a-b0f181e50510 req-142106ad-efcb-47f6-a448-51d74c76fe2f service nova] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_rules [ 999.508833] env[66157]: INFO networking_nsxv3.common.synchronization [req-d0f0b90e-753a-420d-974a-b0f181e50510 req-142106ad-efcb-47f6-a448-51d74c76fe2f service nova] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 999.509068] env[66157]: INFO networking_nsxv3.common.synchronization [req-d0f0b90e-753a-420d-974a-b0f181e50510 req-142106ad-efcb-47f6-a448-51d74c76fe2f service nova] Enqueued Resource ID: 6a04a06f-d4f9-4534-a623-cd976fd57c46 with Priority: HIGHEST for action port [ 999.509505] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_rules [ 999.509710] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 999.509815] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a04a06f-d4f9-4534-a623-cd976fd57c46 with Priority: HIGHEST for action port [ 999.510150] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.510380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.510489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.510781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.510781] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.511692] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.512627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.512686] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a04a06f-d4f9-4534-a623-cd976fd57c46 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.512841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a04a06f-d4f9-4534-a623-cd976fd57c46" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.512841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a04a06f-d4f9-4534-a623-cd976fd57c46" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.513056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a04a06f-d4f9-4534-a623-cd976fd57c46" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.513134] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a04a06f-d4f9-4534-a623-cd976fd57c46',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.015525] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.015846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.017013] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a04a06f-d4f9-4534-a623-cd976fd57c46 with status ACTIVE [ 1000.017218] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.017337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.017402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.017608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.017695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.017860] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.017952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.018027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.018174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.018248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.018426] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.018516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.018577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.018710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.019010] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.019010] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a04a06f-d4f9-4534-a623-cd976fd57c46 is going to be updated. [ 1000.041178] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.041438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.041864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.041864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.042069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.042142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a04a06f-d4f9-4534-a623-cd976fd57c46" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.248760] env[66157]: INFO networking_nsxv3.common.synchronization [req-b0978023-0ecb-407f-b451-214af7333574 req-357d4cbe-f853-454e-a555-498fbb12dbe6 tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 1000.248760] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 1000.248760] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.248760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.249364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.249681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.249961] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.250287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.251840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.251840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.251840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.251840] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.325596] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 1000.325596] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 deletion is rescheduled due to dependency. [ 1000.325596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.325596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.325596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.326940] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.326940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.326940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.326940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.326940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.326940] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.623729] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.623729] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.623955] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.624269] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.624710] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.624976] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.625267] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.625639] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.626229] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.627047] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.627278] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.627574] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.627693] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.628243] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.628243] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.628583] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.650771] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.650771] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1000.650771] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.650986] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-436" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.651531] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-9bd3161b-b696-4b52-b271-9b8105e17b54 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.651881] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-9bd3161b-b696-4b52-b271-9b8105e17b54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.652066] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-9bd3161b-b696-4b52-b271-9b8105e17b54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.652478] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-9bd3161b-b696-4b52-b271-9b8105e17b54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.653101] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd3161b-b696-4b52-b271-9b8105e17b54',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.752546] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.752740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.752913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.753279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.753431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.753666] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.753793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.753864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.754065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.754170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.754259] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 1000.782292] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.782521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.782521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.782701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.782901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.792875] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 1000.829912] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.944810] env[66157]: INFO networking_nsxv3.common.synchronization [None req-605000c7-ca27-48b1-b479-c7f94ab7c8ad None None] Enqueued Resource ID: 84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f with Priority: HIGHEST for action port [ 1000.945835] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f with Priority: HIGHEST for action port [ 1000.946205] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.946361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.946361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.946622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.946707] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.948888] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 in Status: SUCCESS [ 1000.949069] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 deletion is rescheduled due to dependency. [ 1000.949176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.158737] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.159118] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.159118] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.159406] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.159561] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.159732] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 9bd3161b-b696-4b52-b271-9b8105e17b54 not found, creating... [ 1001.159997] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.160172] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.160291] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.160521] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.160679] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.160964] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.161137] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.161931] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.162197] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.162354] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.162502] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 9bd3161b-b696-4b52-b271-9b8105e17b54 is going to be created. [ 1001.184766] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.185014] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.185135] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.185445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.185683] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.186061] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-9bd3161b-b696-4b52-b271-9b8105e17b54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.287085] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ed4675f-1916-4e79-b525-fb7797e97825 in Status: SUCCESS [ 1001.287569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.332434] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.450704] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f [ 1001.451117] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.451334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.451987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.451987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.451987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.452144] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f already deleted. [ 1001.452324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84ef272d-bd4f-46bc-8a5c-ac2f9e1c4a4f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.836461] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.836627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.836695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.836929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.837059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.837163] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 1001.871719] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.871719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.871719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.871719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.871719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.884386] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 1001.984179] env[66157]: INFO networking_nsxv3.common.synchronization [req-b0978023-0ecb-407f-b451-214af7333574 req-d571531b-fb1b-4452-aff1-89071a0e1792 service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 1001.984179] env[66157]: INFO networking_nsxv3.common.synchronization [req-b0978023-0ecb-407f-b451-214af7333574 req-d571531b-fb1b-4452-aff1-89071a0e1792 service nova] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 1001.984179] env[66157]: INFO networking_nsxv3.common.synchronization [req-b0978023-0ecb-407f-b451-214af7333574 req-d571531b-fb1b-4452-aff1-89071a0e1792 service nova] Enqueued Resource ID: 9bd3161b-b696-4b52-b271-9b8105e17b54 with Priority: HIGHEST for action port [ 1001.984179] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_rules [ 1001.984179] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 1001.984179] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd3161b-b696-4b52-b271-9b8105e17b54 with Priority: HIGHEST for action port [ 1001.984179] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.984566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.984803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.985234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.985424] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.987620] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.987859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.988488] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bd3161b-b696-4b52-b271-9b8105e17b54 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.988725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bd3161b-b696-4b52-b271-9b8105e17b54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.988900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bd3161b-b696-4b52-b271-9b8105e17b54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.989183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bd3161b-b696-4b52-b271-9b8105e17b54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.989354] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd3161b-b696-4b52-b271-9b8105e17b54',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.493375] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.493744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.493744] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bd3161b-b696-4b52-b271-9b8105e17b54 with status ACTIVE [ 1002.493970] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.494076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.494076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.494282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.494374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.494548] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.494644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.494704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.494859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.494947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.495250] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.495343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.495407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.495552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.495644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.495739] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bd3161b-b696-4b52-b271-9b8105e17b54 is going to be updated. [ 1002.522542] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.522542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.522542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.522542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.522542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.522818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bd3161b-b696-4b52-b271-9b8105e17b54" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.805517] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 1002.805731] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef deletion is rescheduled due to dependency. [ 1002.805818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.805983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.806313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.806502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.806620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.806686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.806837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.806920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.807028] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.312906] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.535026] env[66157]: INFO networking_nsxv3.common.synchronization [None req-e685c5ac-9939-4418-add3-bfddd17d75cf None None] Enqueued Resource ID: 442e0544-fca2-42c1-9806-fbb83ca15b7c with Priority: HIGHEST for action port [ 1003.537630] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 442e0544-fca2-42c1-9806-fbb83ca15b7c with Priority: HIGHEST for action port [ 1003.537630] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-442e0544-fca2-42c1-9806-fbb83ca15b7c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.537630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-442e0544-fca2-42c1-9806-fbb83ca15b7c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.537630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-442e0544-fca2-42c1-9806-fbb83ca15b7c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.537630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-442e0544-fca2-42c1-9806-fbb83ca15b7c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.537630] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('442e0544-fca2-42c1-9806-fbb83ca15b7c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.815185] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.897446] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 1003.897786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.898109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.898469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.898752] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.898907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.898979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.899162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.899238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.899322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.899431] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.039625] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 442e0544-fca2-42c1-9806-fbb83ca15b7c [ 1004.039940] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.040180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.040312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.040596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.040755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.040903] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:442e0544-fca2-42c1-9806-fbb83ca15b7c already deleted. [ 1004.041051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-442e0544-fca2-42c1-9806-fbb83ca15b7c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.319684] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.319874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.319918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.322328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.322454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.322579] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 1004.325804] env[66157]: INFO networking_nsxv3.common.synchronization [req-c4c7f5db-286c-4cba-a2d9-5981beabcc60 req-9ea999bf-5e33-4076-ac78-0a88c02125d4 tempest-ServersWithSpecificFlavorTestJSON-563142723 tempest-ServersWithSpecificFlavorTestJSON-563142723-project-member] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 1004.326840] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGHEST for action security_group_members [ 1004.327194] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.327806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.327806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.327806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.327806] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.328236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.328236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.328236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.328236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.328358] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.356123] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.356355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.356416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.356641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.356918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.368884] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 1004.403023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.403256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.403256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.403485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.403668] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.403846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.403846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.405252] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.405252] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.405252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.406073] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.830361] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.830730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.830730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.830894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.861188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.861559] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.861727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.861825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.862863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.868400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.868578] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be updated. [ 1004.876720] env[66157]: INFO networking_nsxv3.common.synchronization [req-c40d6a49-47cc-4a4e-bd45-f066ecb2ca5d req-0be2f2a1-d326-40e4-842c-e82fed620bf0 tempest-InstanceActionsNegativeTestJSON-723688958 tempest-InstanceActionsNegativeTestJSON-723688958-project-member] Enqueued Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGHEST for action security_group_members [ 1004.879664] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGHEST for action security_group_members [ 1004.880603] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4020162-d3ee-46af-a408-8b847c1e7ac2 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.880742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.880810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.881085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.881246] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.881342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.881402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.881558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.881648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.881745] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.909443] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83a8fa88-5bec-4b31-8608-ce09049bd610: rpc.has_security_group_logging(os_id): False [ 1004.950858] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.950858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.951587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.951587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.951587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.951716] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.951902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.951958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.952159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.952303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.952843] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.953070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.953070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.953276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.953482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.953603] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.953731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.953862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.954110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.954173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.954341] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 1004.988376] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.988527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.988587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.988807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.988951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.997942] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: IN_PROGRESS for 2s [ 1005.075613] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.075822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.075943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.076624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.078839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.107852] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 1005.387275] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.388116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.388248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.388511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.388605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.388849] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.389023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.389104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.389270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.389336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.389431] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 already deleted. [ 1005.389521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.698174] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.698561] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-294" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.698764] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-294" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.699279] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-294" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.699991] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.700284] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.700537] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.700928] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.701211] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.701802] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.701928] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.702214] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.702408] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.702663] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.702922] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.703508] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.738615] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.738823] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.738965] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.739167] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-294" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.739521] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-2fc60538-b653-42df-a36b-f9100fba1c0d taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.739717] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-2fc60538-b653-42df-a36b-f9100fba1c0d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.739846] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-2fc60538-b653-42df-a36b-f9100fba1c0d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.740213] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-2fc60538-b653-42df-a36b-f9100fba1c0d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.740708] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fc60538-b653-42df-a36b-f9100fba1c0d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.247023] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.247023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.247023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.247023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.247023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.247023] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 2fc60538-b653-42df-a36b-f9100fba1c0d not found, creating... [ 1006.247023] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.247023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.247023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.247023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.247023] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.247704] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.247704] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.247704] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.247922] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.248188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.248477] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 2fc60538-b653-42df-a36b-f9100fba1c0d is going to be created. [ 1006.269141] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.269677] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.269925] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.270362] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.270743] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.271157] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-2fc60538-b653-42df-a36b-f9100fba1c0d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.380686] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 1006.384434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.384434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.384434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.384434] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.384434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.384434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.384434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.384434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.384434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.384434] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.886616] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.886774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.886845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.887080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.888494] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.888621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.888691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.888874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.888962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.889072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.889232] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.889326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.889387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.889538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.889675] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.893141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.893314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.893518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.893735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.893864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.893993] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.010184] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62b70f12-d63b-40fb-b48e-a611590fad1f in Status: SUCCESS [ 1007.011368] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f deletion is rescheduled due to dependency. [ 1007.011368] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.096964] env[66157]: INFO networking_nsxv3.common.synchronization [req-c40d6a49-47cc-4a4e-bd45-f066ecb2ca5d req-12387ed4-db8f-4875-8121-87622444450a service nova] Enqueued Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGHEST for action security_group_rules [ 1007.096964] env[66157]: INFO networking_nsxv3.common.synchronization [req-c40d6a49-47cc-4a4e-bd45-f066ecb2ca5d req-12387ed4-db8f-4875-8121-87622444450a service nova] Enqueued Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGHEST for action security_group_members [ 1007.097193] env[66157]: INFO networking_nsxv3.common.synchronization [req-c40d6a49-47cc-4a4e-bd45-f066ecb2ca5d req-12387ed4-db8f-4875-8121-87622444450a service nova] Enqueued Resource ID: 2fc60538-b653-42df-a36b-f9100fba1c0d with Priority: HIGHEST for action port [ 1007.098081] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGHEST for action security_group_rules [ 1007.098081] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGHEST for action security_group_members [ 1007.098081] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc60538-b653-42df-a36b-f9100fba1c0d with Priority: HIGHEST for action port [ 1007.099449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4020162-d3ee-46af-a408-8b847c1e7ac2 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.099449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.099449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.099449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.099449] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.100574] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4020162-d3ee-46af-a408-8b847c1e7ac2 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.100711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.100897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.101052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.101247] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.101402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.101476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.101676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.101786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.101901] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.106492] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fc60538-b653-42df-a36b-f9100fba1c0d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.106622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fc60538-b653-42df-a36b-f9100fba1c0d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.106733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fc60538-b653-42df-a36b-f9100fba1c0d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.106976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fc60538-b653-42df-a36b-f9100fba1c0d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.108085] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fc60538-b653-42df-a36b-f9100fba1c0d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.127235] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 1007.127235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.396558] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4915dbf-d6e2-46dd-8508-11f50b8da0ef: rpc.has_security_group_logging(os_id): False [ 1007.419622] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.419961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.420096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.420676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.420812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.422610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.422925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.423106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.423413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.423539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.424103] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.424103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.424287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.424419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.424584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.424937] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.425123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.425252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.425729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.425870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.426056] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 1007.494460] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.494612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.494686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.494929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.495150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.515647] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 1007.613054] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4020162-d3ee-46af-a408-8b847c1e7ac2 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.613054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.613054] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.613054] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fc60538-b653-42df-a36b-f9100fba1c0d with status ACTIVE [ 1007.613054] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.613054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.613448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.613747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.613826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.613990] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.614432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.614432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.615405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.615964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.616220] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.616367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.616499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.616687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.616770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.616924] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fc60538-b653-42df-a36b-f9100fba1c0d is going to be updated. [ 1007.649488] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.649692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.649773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.650094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.650652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.650652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fc60538-b653-42df-a36b-f9100fba1c0d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.819137] env[66157]: INFO networking_nsxv3.common.synchronization [None req-a68a1237-4d5b-4aad-a0a4-5ff4306d949e None None] Enqueued Resource ID: a276ed5a-402c-42f2-a82e-5a6a49bfd3b2 with Priority: HIGHEST for action port [ 1007.819637] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a276ed5a-402c-42f2-a82e-5a6a49bfd3b2 with Priority: HIGHEST for action port [ 1007.819858] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a276ed5a-402c-42f2-a82e-5a6a49bfd3b2 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.819858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a276ed5a-402c-42f2-a82e-5a6a49bfd3b2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.820145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a276ed5a-402c-42f2-a82e-5a6a49bfd3b2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.820145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a276ed5a-402c-42f2-a82e-5a6a49bfd3b2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.820228] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a276ed5a-402c-42f2-a82e-5a6a49bfd3b2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.120567] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.326198] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a276ed5a-402c-42f2-a82e-5a6a49bfd3b2 [ 1008.326494] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.326672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.326739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.326940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.327053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.327152] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a276ed5a-402c-42f2-a82e-5a6a49bfd3b2 already deleted. [ 1008.327241] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a276ed5a-402c-42f2-a82e-5a6a49bfd3b2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.515676] env[66157]: INFO networking_nsxv3.common.synchronization [None req-b703a006-35b3-456d-9a95-cdaf81dbb184 tempest-ServerActionsV293TestJSON-294038275 tempest-ServerActionsV293TestJSON-294038275-project-member] Enqueued Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_rules [ 1008.517143] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_rules [ 1008.517476] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.517598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.517738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.518187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.518736] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.621547] env[66157]: INFO networking_nsxv3.common.synchronization [None req-bb48b6ca-0981-4ebb-bc22-33ecf53996a4 tempest-ServerActionsV293TestJSON-294038275 tempest-ServerActionsV293TestJSON-294038275-project-member] Enqueued Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_rules [ 1008.621980] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.622402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.622402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.622402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.622562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.622562] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 is going to be created. [ 1008.623897] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_rules [ 1008.624220] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.624320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.651042] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.651209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.651284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.651576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.651753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.662685] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 in Status: UNINITIALIZED for 2s [ 1009.049907] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.050153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.050239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.050836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.051019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.051218] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d already deleted. [ 1009.051354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.051559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.051795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.051927] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.537148] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 1009.537148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.576748] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.576820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.576850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.577071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.577164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.577286] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d already deleted. [ 1009.577338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.204925] env[66157]: INFO networking_nsxv3.common.synchronization [None req-5675087d-ff26-426b-a323-06e6d038a493 None None] Enqueued Resource ID: 90a81b24-6e93-4f9f-942e-2b778f215d87 with Priority: HIGHEST for action port [ 1010.205547] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90a81b24-6e93-4f9f-942e-2b778f215d87 with Priority: HIGHEST for action port [ 1010.205868] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-90a81b24-6e93-4f9f-942e-2b778f215d87 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.205980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90a81b24-6e93-4f9f-942e-2b778f215d87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.207602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90a81b24-6e93-4f9f-942e-2b778f215d87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.208354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90a81b24-6e93-4f9f-942e-2b778f215d87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.208354] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90a81b24-6e93-4f9f-942e-2b778f215d87',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.290715] env[66157]: INFO networking_nsxv3.common.synchronization [req-2fc94668-947e-44b1-ba21-ebfab323c735 req-2dfeb2fc-a8da-49ef-bec8-5d6ad80e9650 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1010.292726] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1010.292726] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.292876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.292876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.293281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.293544] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.293713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.293824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.294174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.294343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.294502] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.677031] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 in Status: SUCCESS [ 1010.677031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.677031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.677031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.677031] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.677031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.677031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.677031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.677031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.677031] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.677031] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.711033] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90a81b24-6e93-4f9f-942e-2b778f215d87 [ 1010.711033] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.711033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.711033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.711033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.711033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.711033] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90a81b24-6e93-4f9f-942e-2b778f215d87 already deleted. [ 1010.711033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90a81b24-6e93-4f9f-942e-2b778f215d87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.801238] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.801238] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.801238] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e already deleted. [ 1010.801238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.182539] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4020162-d3ee-46af-a408-8b847c1e7ac2 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.182539] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.182539] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4020162-d3ee-46af-a408-8b847c1e7ac2 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.182539] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.182539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.183210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.183210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.183210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.183210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.183210] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.367687] env[66157]: INFO networking_nsxv3.common.synchronization [req-bc56ed28-1978-4d39-80d2-f12d5db2072e req-b085b5f8-5198-4d84-939e-a74203a830c4 tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1011.367961] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1011.368380] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.368449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.368495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.368773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.368841] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.369517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.369517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.369517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.369517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.369517] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.413238] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.413610] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.413769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.414100] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.414429] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.414645] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.414801] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.415097] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.415260] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.415544] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.415700] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.415835] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.415972] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.416153] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.416278] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.416425] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.441085] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.441264] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.441370] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.441498] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.441861] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-e981694d-5b51-4bd5-8b38-7754d0843089 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.442052] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-e981694d-5b51-4bd5-8b38-7754d0843089" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.442176] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-e981694d-5b51-4bd5-8b38-7754d0843089" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.442528] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-e981694d-5b51-4bd5-8b38-7754d0843089" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.442682] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e981694d-5b51-4bd5-8b38-7754d0843089',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.687243] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4020162-d3ee-46af-a408-8b847c1e7ac2: rpc.has_security_group_logging(os_id): False [ 1011.706920] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.707132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.707180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.707383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.707476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.707786] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.707989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.707989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.708156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.708232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.708435] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.708532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.708595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.708736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.708812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.709497] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.709497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.709497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.709894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.709970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.710068] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 is going to be created. [ 1011.783851] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.784065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.784125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.784292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.784589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.798961] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 in Status: IN_PROGRESS for 2s [ 1011.871493] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.946749] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.946994] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.947135] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.947408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.947559] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.947715] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port e981694d-5b51-4bd5-8b38-7754d0843089 not found, creating... [ 1011.948085] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.948251] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.948368] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.948589] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.948733] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.949035] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.949193] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.949306] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.949508] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.949696] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.949779] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: e981694d-5b51-4bd5-8b38-7754d0843089 is going to be created. [ 1011.985392] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.985712] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.985873] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.986241] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.986620] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.986914] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-e981694d-5b51-4bd5-8b38-7754d0843089" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.375816] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.793712] env[66157]: INFO networking_nsxv3.common.synchronization [req-2fc94668-947e-44b1-ba21-ebfab323c735 req-448caf11-5fce-4d05-9375-0fc52fdf1830 service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1012.794078] env[66157]: INFO networking_nsxv3.common.synchronization [req-2fc94668-947e-44b1-ba21-ebfab323c735 req-448caf11-5fce-4d05-9375-0fc52fdf1830 service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1012.794078] env[66157]: INFO networking_nsxv3.common.synchronization [req-2fc94668-947e-44b1-ba21-ebfab323c735 req-448caf11-5fce-4d05-9375-0fc52fdf1830 service nova] Enqueued Resource ID: e981694d-5b51-4bd5-8b38-7754d0843089 with Priority: HIGHEST for action port [ 1012.794855] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1012.795016] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1012.795172] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e981694d-5b51-4bd5-8b38-7754d0843089 with Priority: HIGHEST for action port [ 1012.796036] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.796145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.796242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.796419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.796529] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.797870] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.798448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.798448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.798448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.798617] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.798735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.798791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.798969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.799101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.799344] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.801483] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e981694d-5b51-4bd5-8b38-7754d0843089 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.801628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e981694d-5b51-4bd5-8b38-7754d0843089" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.801713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e981694d-5b51-4bd5-8b38-7754d0843089" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.801895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e981694d-5b51-4bd5-8b38-7754d0843089" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.801977] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e981694d-5b51-4bd5-8b38-7754d0843089',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.878885] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.879080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.879278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.880033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.880033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.880033] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1012.911541] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.911737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.911737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.911924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.912093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.923106] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1013.305151] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.307043] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.307043] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.307216] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e981694d-5b51-4bd5-8b38-7754d0843089 with status ACTIVE [ 1013.307933] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.307933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.307933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.307933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.308177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.308177] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.308268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.310832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.310832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.310832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.310832] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.310832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.310832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.310832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.310832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.310832] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e981694d-5b51-4bd5-8b38-7754d0843089 is going to be updated. [ 1013.335642] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.335642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.335642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.335790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.336013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.336260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e981694d-5b51-4bd5-8b38-7754d0843089" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.622486] env[66157]: INFO networking_nsxv3.common.synchronization [req-f91a71e5-319b-456b-8daf-ad7d53d69ecc req-0a1622b5-a394-4839-8039-b9a7a8f248bd tempest-AttachInterfacesV270Test-462661881 tempest-AttachInterfacesV270Test-462661881-project-member] Enqueued Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGHEST for action security_group_members [ 1013.623310] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGHEST for action security_group_members [ 1013.626825] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-047471a8-6f49-4481-a53f-c45f9c23e798 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.626825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.626825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.626825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.626825] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.626825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.626825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.626825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.626825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.626825] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.811300] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.813215] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 in Status: SUCCESS [ 1013.813532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.014262] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.014262] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-88" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.014262] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-88" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.014653] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-88" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.014705] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.015446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.015446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.015446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.015446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.015789] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.016038] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.016410] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.016410] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.016410] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.016633] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.016828] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.037089] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.037577] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1014.037577] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.037577] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-88" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.037915] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-e011594f-4fb7-4cfb-ae3d-6155d96648d1 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.038184] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-e011594f-4fb7-4cfb-ae3d-6155d96648d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.038317] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-e011594f-4fb7-4cfb-ae3d-6155d96648d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.038824] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-e011594f-4fb7-4cfb-ae3d-6155d96648d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.038824] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e011594f-4fb7-4cfb-ae3d-6155d96648d1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.129449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.129449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.129449] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 047471a8-6f49-4481-a53f-c45f9c23e798 already deleted. [ 1014.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.315273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.315511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.315511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.315728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.315865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.315968] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be created. [ 1014.346258] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.346466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.346552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.346926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.347158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.358649] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: UNINITIALIZED for 2s [ 1014.542902] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.542902] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.542902] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.543232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.544306] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.544306] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port e011594f-4fb7-4cfb-ae3d-6155d96648d1 not found, creating... [ 1014.544306] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.544306] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.544306] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.544562] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.544562] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.544833] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.544977] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.545138] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.545385] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.545527] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.545684] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: e011594f-4fb7-4cfb-ae3d-6155d96648d1 is going to be created. [ 1014.577512] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.577730] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.577841] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.578192] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.578452] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.578675] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-e011594f-4fb7-4cfb-ae3d-6155d96648d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.940554] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1014.940913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.294362] env[66157]: INFO networking_nsxv3.common.synchronization [req-f91a71e5-319b-456b-8daf-ad7d53d69ecc req-0ccd3ab7-df9f-4e1e-8e15-ecf1bd7b09cc service nova] Enqueued Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGHEST for action security_group_rules [ 1015.294604] env[66157]: INFO networking_nsxv3.common.synchronization [req-f91a71e5-319b-456b-8daf-ad7d53d69ecc req-0ccd3ab7-df9f-4e1e-8e15-ecf1bd7b09cc service nova] Enqueued Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGHEST for action security_group_members [ 1015.294866] env[66157]: INFO networking_nsxv3.common.synchronization [req-f91a71e5-319b-456b-8daf-ad7d53d69ecc req-0ccd3ab7-df9f-4e1e-8e15-ecf1bd7b09cc service nova] Enqueued Resource ID: e011594f-4fb7-4cfb-ae3d-6155d96648d1 with Priority: HIGHEST for action port [ 1015.295435] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGHEST for action security_group_rules [ 1015.295569] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGHEST for action security_group_members [ 1015.295778] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e011594f-4fb7-4cfb-ae3d-6155d96648d1 with Priority: HIGHEST for action port [ 1015.296116] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-047471a8-6f49-4481-a53f-c45f9c23e798 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.296228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.296292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.296538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.296615] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.297614] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-047471a8-6f49-4481-a53f-c45f9c23e798 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.297724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.297791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.297959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.298124] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.298215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.298273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.298413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.298502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.298598] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.299426] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e011594f-4fb7-4cfb-ae3d-6155d96648d1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.299542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e011594f-4fb7-4cfb-ae3d-6155d96648d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.299590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e011594f-4fb7-4cfb-ae3d-6155d96648d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.299762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e011594f-4fb7-4cfb-ae3d-6155d96648d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.299838] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e011594f-4fb7-4cfb-ae3d-6155d96648d1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.804157] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-047471a8-6f49-4481-a53f-c45f9c23e798 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.804415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.804712] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.806517] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e011594f-4fb7-4cfb-ae3d-6155d96648d1 with status ACTIVE [ 1015.806726] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.807193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.807193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.807327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.807453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.807743] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.807968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.808121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.808800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.808800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.808800] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.809093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.809093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.809182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.809287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.809419] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e011594f-4fb7-4cfb-ae3d-6155d96648d1 is going to be updated. [ 1015.836353] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.836553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.836640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.837334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.837334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.837334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e011594f-4fb7-4cfb-ae3d-6155d96648d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.313993] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.370874] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1016.371272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.371517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.371776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.372015] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.372180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.372267] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.372752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.372752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.372752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.372948] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.819118] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.819794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.820061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.820672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.820672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.820672] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 047471a8-6f49-4481-a53f-c45f9c23e798 is going to be created. [ 1016.860030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.860445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.860647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.861942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.862998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.876369] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.876585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.876585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.876911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.877312] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.877312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.877312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.877630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.877630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.877630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.877729] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.877952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.877952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.878099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.878259] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.878724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.878819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.878975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.879075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.879449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.879449] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.882579] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 047471a8-6f49-4481-a53f-c45f9c23e798 in Status: UNINITIALIZED for 2s [ 1017.384026] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fec754f5-f737-48ef-9255-9d4bc7df0c2e: rpc.has_security_group_logging(os_id): False [ 1017.409662] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.409662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.409662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.410100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.410100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.410387] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.410530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.410824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.410824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.410940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.411142] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.411336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.411406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.411578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.411674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.411918] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.412160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.412160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.412377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.412416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.412533] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be created. [ 1017.487503] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.488465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.488465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.488465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.488465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.501475] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1018.895430] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 047471a8-6f49-4481-a53f-c45f9c23e798 in Status: SUCCESS [ 1018.895430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.895430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.895430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.895430] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.895430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.895430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.895430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.895430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.895430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.895430] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.399758] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-047471a8-6f49-4481-a53f-c45f9c23e798 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.399957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.400084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.400318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.400513] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.400601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.400648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.400796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.400882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.400963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.401177] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-047471a8-6f49-4481-a53f-c45f9c23e798 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.401255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.401255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.401384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.401515] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.401604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.401659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.401772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.401848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.401960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.402084] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.520267] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1019.521191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.904343] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 047471a8-6f49-4481-a53f-c45f9c23e798: rpc.has_security_group_logging(os_id): False [ 1019.930316] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.930316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.930316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.930316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.930316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.930316] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.930316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.930316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.930316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.930316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.931512] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.931512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.931512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.931512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.931512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.931512] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.931512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.931512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.931512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.931839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.931839] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 047471a8-6f49-4481-a53f-c45f9c23e798 is going to be created. [ 1020.012278] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.012716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.012796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.013051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.013323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.043290] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 047471a8-6f49-4481-a53f-c45f9c23e798 in Status: IN_PROGRESS for 2s [ 1020.297374] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1020.297374] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1020.593943] env[66157]: INFO networking_nsxv3.common.synchronization [req-ffae80ee-3558-497e-8eff-ccdcea374c88 req-73a45a03-e583-49b6-95d6-331a7aacb1a9 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1020.594549] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1020.594860] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.594983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.595867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.596157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.596220] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.596308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.596365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.596536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.596620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.596946] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.619243] env[66157]: INFO networking_nsxv3.common.synchronization [req-ffae80ee-3558-497e-8eff-ccdcea374c88 req-73a45a03-e583-49b6-95d6-331a7aacb1a9 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 1020.622639] env[66157]: INFO networking_nsxv3.common.synchronization [req-ffae80ee-3558-497e-8eff-ccdcea374c88 req-73a45a03-e583-49b6-95d6-331a7aacb1a9 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1020.622639] env[66157]: INFO networking_nsxv3.common.synchronization [req-ffae80ee-3558-497e-8eff-ccdcea374c88 req-73a45a03-e583-49b6-95d6-331a7aacb1a9 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with Priority: HIGHEST for action port [ 1020.622639] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 1020.624844] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1020.624844] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with Priority: HIGHEST for action port [ 1020.624844] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.624844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.624844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.624844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.624844] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.626112] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.626112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.626335] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-50a3b9ca-c1b8-41b7-95bf-c0865270c868 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.626496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.626496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.626666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.626742] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50a3b9ca-c1b8-41b7-95bf-c0865270c868',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.774606] env[66157]: INFO networking_nsxv3.common.synchronization [req-afafcd08-9c0e-4a8f-b37b-26310769fe6a req-de1095d4-5532-4498-bce7-bde8ddacdc66 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 1020.775228] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 1020.775550] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.775684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.775743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.776158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.776158] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.776362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.776362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.776527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.776527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.776641] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.099594] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.129299] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.129505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.129603] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with status ACTIVE [ 1021.129766] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.129965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.130054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.130249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.130343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.130516] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.130686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.130686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.130835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.130889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.131086] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.131174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.131235] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.131390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.131443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.131518] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 is going to be updated. [ 1021.152986] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.153156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.153228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.153603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.153603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.153729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.196867] env[66157]: INFO networking_nsxv3.common.synchronization [req-35ab3844-f44e-4d94-a10f-149dbfaf8974 req-eca530e2-0e5d-4599-9663-f1b704c9c72a tempest-InstanceActionsNegativeTestJSON-723688958 tempest-InstanceActionsNegativeTestJSON-723688958-project-member] Enqueued Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGHEST for action security_group_members [ 1021.197901] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGHEST for action security_group_members [ 1021.197901] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4020162-d3ee-46af-a408-8b847c1e7ac2 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.198072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.198072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.198207] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.198359] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.198454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.198515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.198656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.198761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.198900] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.279612] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.279851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.279851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.280114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.280330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.280859] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.280996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.281266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.281266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.283160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.283160] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be updated. [ 1021.330582] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.330875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.330953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.331535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.331535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.344462] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: IN_PROGRESS for 2s [ 1021.603609] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.701118] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.701436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.701436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.701631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.701690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.701887] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.702048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.702048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.702255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.702255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.702536] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 is going to be updated. [ 1021.735165] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.735165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.735165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.735165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.735587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.749614] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 in Status: IN_PROGRESS for 2s [ 1022.058974] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 047471a8-6f49-4481-a53f-c45f9c23e798 in Status: SUCCESS [ 1022.059248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.106099] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.106433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.106433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.107261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.107261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.107261] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 is going to be updated. [ 1022.126923] env[66157]: INFO networking_nsxv3.common.synchronization [None req-3c1a44ad-e9d0-4ec1-ba4a-149f6d5a4ffb None None] Enqueued Resource ID: 2eddecc9-80ae-495c-ada2-e79aa3e12283 with Priority: HIGHEST for action port [ 1022.127531] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eddecc9-80ae-495c-ada2-e79aa3e12283 with Priority: HIGHEST for action port [ 1022.127845] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eddecc9-80ae-495c-ada2-e79aa3e12283 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.127971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eddecc9-80ae-495c-ada2-e79aa3e12283" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.128133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eddecc9-80ae-495c-ada2-e79aa3e12283" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.130168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eddecc9-80ae-495c-ada2-e79aa3e12283" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.130168] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eddecc9-80ae-495c-ada2-e79aa3e12283',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.156891] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.159553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.159553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.159553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.159553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.168482] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: IN_PROGRESS for 2s [ 1022.631116] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2eddecc9-80ae-495c-ada2-e79aa3e12283 [ 1022.631371] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.631508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.631574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.631993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.631993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.631993] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2eddecc9-80ae-495c-ada2-e79aa3e12283 already deleted. [ 1022.632183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eddecc9-80ae-495c-ada2-e79aa3e12283" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.784322] env[66157]: INFO networking_nsxv3.common.synchronization [req-c8150c76-4a69-4c54-8376-9d7dc8140009 req-2dac58e0-61cf-4b4f-a540-ee02769fce26 tempest-ServersNegativeTestJSON-423798559 tempest-ServersNegativeTestJSON-423798559-project-member] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1022.784322] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1022.784674] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.784674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.784674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.785082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.785082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.785082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.785361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.785361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.785430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.785804] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.187979] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.188305] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.189188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.191372] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.191996] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.192189] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.192313] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.192547] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.192696] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.192902] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.193023] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.193133] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.193243] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.193354] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.193458] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.193710] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.213050] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.213198] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.213234] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.213408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.213722] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-c0254448-6efe-42cb-b178-3c95649cb256 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.214475] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.214475] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.214475] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.214617] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0254448-6efe-42cb-b178-3c95649cb256',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.287917] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.288093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.288173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.288476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.288612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.288786] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.288973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.289034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.289180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.289268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.289364] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b already deleted. [ 1023.289447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.360896] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: SUCCESS [ 1023.361254] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 deletion is rescheduled due to dependency. [ 1023.361254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.717314] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.717570] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.717707] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.718111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.718325] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.718549] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port c0254448-6efe-42cb-b178-3c95649cb256 not found, creating... [ 1023.718895] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.719093] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.719225] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.719750] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.719838] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.720181] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.720342] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.720457] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.720695] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.720809] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.720958] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: c0254448-6efe-42cb-b178-3c95649cb256 is going to be created. [ 1023.748560] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.748560] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.748560] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.748907] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.749026] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.749393] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.762552] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 in Status: SUCCESS [ 1023.762780] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 deletion is rescheduled due to dependency. [ 1023.762901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.912948] env[66157]: INFO networking_nsxv3.common.synchronization [req-3f152f6c-4184-4950-b1f9-1d9bb35d82db req-6274b32d-ad89-4d4b-af54-b422bc95b04a tempest-ImagesTestJSON-80718839 tempest-ImagesTestJSON-80718839-project-member] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 1023.913622] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGHEST for action security_group_members [ 1023.913975] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.914388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.914388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.914614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.914787] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.914876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.914945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.915103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.915185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.915281] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.178773] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: SUCCESS [ 1024.178986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.179172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.179420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.179602] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.179757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.179757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.179900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.179981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.180087] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.413977] env[66157]: INFO networking_nsxv3.common.synchronization [None req-6a3cd510-a3c8-482f-b950-ca15e89cd38b None None] Enqueued Resource ID: c45b83ae-95b1-46e1-8f54-6e53db0effac with Priority: HIGHEST for action port [ 1024.413977] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c45b83ae-95b1-46e1-8f54-6e53db0effac with Priority: HIGHEST for action port [ 1024.413977] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-c45b83ae-95b1-46e1-8f54-6e53db0effac taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.413977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c45b83ae-95b1-46e1-8f54-6e53db0effac" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.414642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c45b83ae-95b1-46e1-8f54-6e53db0effac" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.414642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c45b83ae-95b1-46e1-8f54-6e53db0effac" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.414642] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c45b83ae-95b1-46e1-8f54-6e53db0effac',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.417792] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.418076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.418149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.418841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.418841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.418841] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.418841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.418841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.419272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.419272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.419272] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be updated. [ 1024.453036] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.453188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.453699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.453699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.453699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.463841] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: IN_PROGRESS for 2s [ 1024.483102] env[66157]: INFO networking_nsxv3.common.synchronization [req-c8150c76-4a69-4c54-8376-9d7dc8140009 req-a1c8934e-abd8-4d44-aada-35daa118968c service nova] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_rules [ 1024.483227] env[66157]: INFO networking_nsxv3.common.synchronization [req-c8150c76-4a69-4c54-8376-9d7dc8140009 req-a1c8934e-abd8-4d44-aada-35daa118968c service nova] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1024.483555] env[66157]: INFO networking_nsxv3.common.synchronization [req-c8150c76-4a69-4c54-8376-9d7dc8140009 req-a1c8934e-abd8-4d44-aada-35daa118968c service nova] Enqueued Resource ID: c0254448-6efe-42cb-b178-3c95649cb256 with Priority: HIGHEST for action port [ 1024.483926] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_rules [ 1024.484431] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1024.484431] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0254448-6efe-42cb-b178-3c95649cb256 with Priority: HIGHEST for action port [ 1024.485733] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.485733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.485733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.485733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.485733] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.488616] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.488744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.488880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.489018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.489625] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.490390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.490390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.490390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.490548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.490635] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.493142] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0254448-6efe-42cb-b178-3c95649cb256 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.496867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.497108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.497301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.497364] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0254448-6efe-42cb-b178-3c95649cb256',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.681880] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.916544] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c45b83ae-95b1-46e1-8f54-6e53db0effac [ 1024.916826] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.916960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.917097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.917357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.917463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.917564] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c45b83ae-95b1-46e1-8f54-6e53db0effac already deleted. [ 1024.917662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c45b83ae-95b1-46e1-8f54-6e53db0effac" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.989067] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.989278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.999732] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.001036] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0254448-6efe-42cb-b178-3c95649cb256 with status ACTIVE [ 1025.001294] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.001440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.001509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.001733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.001867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.002068] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.002171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.002244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.002474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.002727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.002802] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.002982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.002982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.005661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.005763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.005909] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0254448-6efe-42cb-b178-3c95649cb256 is going to be updated. [ 1025.052760] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.052760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.052760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.052760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.052760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.053136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.185620] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.196897] env[66157]: INFO networking_nsxv3.common.synchronization [req-b8819638-1fee-4f6c-9b46-a29ee0b53f09 req-e4314e63-3a90-4846-a74d-fb2baeadd3b4 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1025.197585] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1025.197920] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.198139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.214419] env[66157]: INFO networking_nsxv3.common.synchronization [req-b8819638-1fee-4f6c-9b46-a29ee0b53f09 req-e4314e63-3a90-4846-a74d-fb2baeadd3b4 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 1025.214610] env[66157]: INFO networking_nsxv3.common.synchronization [req-b8819638-1fee-4f6c-9b46-a29ee0b53f09 req-e4314e63-3a90-4846-a74d-fb2baeadd3b4 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1025.214752] env[66157]: INFO networking_nsxv3.common.synchronization [req-b8819638-1fee-4f6c-9b46-a29ee0b53f09 req-e4314e63-3a90-4846-a74d-fb2baeadd3b4 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with Priority: HIGHEST for action port [ 1025.215826] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_rules [ 1025.215968] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1025.216148] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with Priority: HIGHEST for action port [ 1025.216668] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.216780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.217071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.217071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.217272] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-50a3b9ca-c1b8-41b7-95bf-c0865270c868 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.217386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.217449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.217647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.217728] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50a3b9ca-c1b8-41b7-95bf-c0865270c868',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.477737] env[66157]: INFO networking_nsxv3.common.synchronization [req-bccf0c23-86f1-4b4a-af65-ce8fda4887af req-1095c2c0-014f-44d4-9281-f214ce675336 tempest-ImagesOneServerNegativeTestJSON-417779338 tempest-ImagesOneServerNegativeTestJSON-417779338-project-member] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 1025.478547] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 1025.478898] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.478965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.479983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.480363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.480726] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.480845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.480904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.481072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.481924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.481924] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.508642] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.688686] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.688686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.688686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.688686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.689768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.690787] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 is going to be updated. [ 1025.722408] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50a3b9ca-c1b8-41b7-95bf-c0865270c868 with status ACTIVE [ 1025.722787] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.722787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.722975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.723151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.723221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.726861] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.726861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.726861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.726861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.726861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.726861] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.726861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.726861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.726861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.726861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.726861] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50a3b9ca-c1b8-41b7-95bf-c0865270c868 is going to be updated. [ 1025.738505] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.738889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.739024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.739571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.739745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.767376] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: IN_PROGRESS for 2s [ 1025.769947] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.770233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.770314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.770530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.770668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.770821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50a3b9ca-c1b8-41b7-95bf-c0865270c868" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.983456] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.983625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.983731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.984039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.984183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.984494] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.984656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.985024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.985024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.985131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.985264] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 1026.014768] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.015664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.015894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.016304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.016522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.016770] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be created. [ 1026.018999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.020493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.021234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.021234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.023522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.031542] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 1026.046512] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.046985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.047248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.047554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.047820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.058498] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: UNINITIALIZED for 2s [ 1026.473784] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef in Status: SUCCESS [ 1026.473784] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef deletion is rescheduled due to dependency. [ 1026.473784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.794855] env[66157]: INFO networking_nsxv3.common.synchronization [req-8e1ec616-fd8e-45fe-b89f-50731aff6a37 req-83677ab6-260f-4a8a-9efa-ffeac1f847db tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1026.795296] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1026.795532] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.795649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.795714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.795982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.796815] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.797102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.797102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.797527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.797527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.797657] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.300573] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.300789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.300832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.301134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.301257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.301519] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.301660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.301735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.301920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.302035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.302148] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1027.342437] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.342437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.342437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.342437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.342437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.351651] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1027.778745] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: SUCCESS [ 1027.778745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.778745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.779009] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.782598] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.782598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.782598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.782598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.782598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.782598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.782598] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.782598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.782598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.783405] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.783405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.783405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.783405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.783405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.783405] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.044852] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 1028.045132] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 deletion is rescheduled due to dependency. [ 1028.045186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.068116] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1028.068116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.068322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.068580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.068779] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.069747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.069747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.069747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.069747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.069747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.069747] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.286577] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.286577] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.572521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.572521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.572521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.572521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.572521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.572521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.572521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.572904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.572904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.572904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.572998] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.573979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.573979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.573979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.573979] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.573979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.573979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.573979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.573979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.573979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.582719] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.789375] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c332a559-4644-4adb-a746-9d19b0df0c73: rpc.has_security_group_logging(os_id): False [ 1028.791355] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.811065] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.811356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.811356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.811588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.811668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.811927] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.812055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.812124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.812274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.812350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.812433] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 is going to be updated. [ 1028.915381] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.916058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.916058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.916189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.916504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.939066] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: IN_PROGRESS for 2s [ 1029.076540] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a3d86b0-5e47-4031-aa77-b1a917545a8b: rpc.has_security_group_logging(os_id): False [ 1029.106452] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.106665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.106748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.107217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.107411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.107872] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.108034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.108231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.108531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.108531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.108787] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.108916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.108961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.110702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.110702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.110702] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.110702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.110702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.110702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.110702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.110702] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be created. [ 1029.201975] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.201975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.201975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.202589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.202589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.216351] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1029.293671] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.293888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.293950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.294203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.294308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.294457] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 is going to be updated. [ 1029.365381] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1029.365569] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e deletion is rescheduled due to dependency. [ 1029.365686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.377316] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.377437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.378066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.378256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.378472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.389294] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: IN_PROGRESS for 2s [ 1030.222164] env[66157]: INFO networking_nsxv3.common.synchronization [req-9e42ea24-eb97-4bda-9506-31fd15206a5a req-aa344f91-231f-408d-962e-51a975705041 tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 1030.223060] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 1030.223250] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.223393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.223461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.223657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.223811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.223905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.223967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.224132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.224222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.224333] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.482858] env[66157]: INFO networking_nsxv3.common.synchronization [req-0a26e0ba-e448-4e4e-833a-69fa4a291fd3 req-61a37338-72c4-43cb-a61e-592f6b62fa43 tempest-AttachInterfacesUnderV243Test-1964565282 tempest-AttachInterfacesUnderV243Test-1964565282-project-member] Enqueued Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1030.483471] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c332a559-4644-4adb-a746-9d19b0df0c73 with Priority: HIGHEST for action security_group_members [ 1030.483792] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-c332a559-4644-4adb-a746-9d19b0df0c73 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.483900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.507837] env[66157]: INFO networking_nsxv3.common.synchronization [req-bf3e4415-4088-4fae-b898-b2bfcf03a13c req-852183f0-3d61-46ea-ad1b-bd93e85459ea tempest-AttachInterfacesV270Test-462661881 tempest-AttachInterfacesV270Test-462661881-project-member] Enqueued Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGHEST for action security_group_members [ 1030.508965] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGHEST for action security_group_members [ 1030.508965] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-047471a8-6f49-4481-a53f-c45f9c23e798 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.508965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.508965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.509303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.509441] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.509503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.509538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.509697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.509782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.509875] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.726863] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.726863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.726863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.727074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.727074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.728508] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.728508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.728508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.729628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.729717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.729815] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 1030.764067] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.764216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.764351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.764524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.764681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.792760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 1030.941918] env[66157]: INFO networking_nsxv3.common.synchronization [req-80460b40-e8c4-46c2-9cbb-ba931cbe282d req-fb5a673d-3109-481d-b84d-7ab88cd131cd tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_members [ 1030.942982] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGHEST for action security_group_members [ 1030.943273] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.944016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.944016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.944016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.944016] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.944016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.944375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.944375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.944375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.944464] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.953596] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: SUCCESS [ 1030.954364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.954364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.954364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.954624] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.012510] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.012510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.012510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.013116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.013116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.013116] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.013116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.013422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.013422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.013422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.013528] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 047471a8-6f49-4481-a53f-c45f9c23e798 is going to be updated. [ 1031.043511] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.043668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.043760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.043983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.044228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.055443] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 047471a8-6f49-4481-a53f-c45f9c23e798 in Status: IN_PROGRESS for 2s [ 1031.235902] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1031.236207] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.399675] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c332a559-4644-4adb-a746-9d19b0df0c73 in Status: SUCCESS [ 1031.400420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.400420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.400420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.400704] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.401090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.401090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.401090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.401290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.401545] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.446149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.446303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.446414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.446642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.452330] env[66157]: INFO networking_nsxv3.common.synchronization [req-91619712-847d-4ae1-8b86-565f70976156 req-b3f43121-83e2-46d7-a10e-326ac87982c0 tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1031.453055] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1031.453382] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.453505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.453572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.453763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.456035] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.456035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.456035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.456035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.456035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.456035] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.469279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.471567] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.471567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.471567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.471567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.471567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.471567] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b is going to be updated. [ 1031.474010] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.474289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.474452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.474717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.474890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.476017] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 is going to be deleted. [ 1031.500487] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.500487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.500487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.500487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.500487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.509706] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b in Status: IN_PROGRESS for 2s [ 1031.532055] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.532651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.532816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.533505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.533505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.533505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.904934] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.905182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.905289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.905545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.905641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.905897] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.906017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.906123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.906341] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.906452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.906549] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 is going to be deleted. [ 1031.936786] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.936786] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.937870] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.937870] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.937870] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.937870] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.937870] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.937870] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.938108] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.938242] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.938343] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.938452] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.938715] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.938715] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.938823] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.938909] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.944993] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.945140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.945231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.945381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.945468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.945567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.945722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.945870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.946039] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.946132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.946191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.946324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.946439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.946532] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c332a559-4644-4adb-a746-9d19b0df0c73',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.957017] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.957127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.957168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.957354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.957458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.957634] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.957731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.957792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.957934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.958125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.958125] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1031.964347] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.964533] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.964675] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.964846] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.965173] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-48c0fd61-715a-44ba-a067-7f81fec3e727 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.965329] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-48c0fd61-715a-44ba-a067-7f81fec3e727" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.965445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-48c0fd61-715a-44ba-a067-7f81fec3e727" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.965758] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-48c0fd61-715a-44ba-a067-7f81fec3e727" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.965898] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48c0fd61-715a-44ba-a067-7f81fec3e727',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.986012] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.986222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.986318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.986594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.986778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.997064] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1032.449144] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.449544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.449544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.449544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.449743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.449841] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.449910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.449972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.450190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.450263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.451245] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c332a559-4644-4adb-a746-9d19b0df0c73 already deleted. [ 1032.451703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c332a559-4644-4adb-a746-9d19b0df0c73" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.469112] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.470338] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.470338] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.470338] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.470338] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.470569] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 48c0fd61-715a-44ba-a067-7f81fec3e727 not found, creating... [ 1032.470844] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.471104] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.471286] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.471601] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.471799] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.472251] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.472611] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.472698] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.473637] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.473637] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.473637] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 48c0fd61-715a-44ba-a067-7f81fec3e727 is going to be created. [ 1032.495324] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.495614] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.495764] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.496152] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.496333] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.496774] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-48c0fd61-715a-44ba-a067-7f81fec3e727" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.802943] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 1032.803223] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 1032.803412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.066297] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 047471a8-6f49-4481-a53f-c45f9c23e798 in Status: SUCCESS [ 1033.066568] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 047471a8-6f49-4481-a53f-c45f9c23e798 deletion is rescheduled due to dependency. [ 1033.066722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.222973] env[66157]: INFO networking_nsxv3.common.synchronization [req-91619712-847d-4ae1-8b86-565f70976156 req-4f59a125-f101-45e8-8581-7eb4de1a6983 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 1033.222973] env[66157]: INFO networking_nsxv3.common.synchronization [req-91619712-847d-4ae1-8b86-565f70976156 req-4f59a125-f101-45e8-8581-7eb4de1a6983 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1033.222973] env[66157]: INFO networking_nsxv3.common.synchronization [req-91619712-847d-4ae1-8b86-565f70976156 req-4f59a125-f101-45e8-8581-7eb4de1a6983 service nova] Enqueued Resource ID: 48c0fd61-715a-44ba-a067-7f81fec3e727 with Priority: HIGHEST for action port [ 1033.223495] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 1033.223631] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1033.223730] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c0fd61-715a-44ba-a067-7f81fec3e727 with Priority: HIGHEST for action port [ 1033.223995] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.224159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.224280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.224445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.224486] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.225280] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.225362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.225558] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-48c0fd61-715a-44ba-a067-7f81fec3e727 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.225641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48c0fd61-715a-44ba-a067-7f81fec3e727" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.225727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48c0fd61-715a-44ba-a067-7f81fec3e727" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.225861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48c0fd61-715a-44ba-a067-7f81fec3e727" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.225940] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48c0fd61-715a-44ba-a067-7f81fec3e727',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.519873] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b in Status: SUCCESS [ 1033.520190] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b deletion is rescheduled due to dependency. [ 1033.520190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.728985] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.729212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.729373] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48c0fd61-715a-44ba-a067-7f81fec3e727 with status ACTIVE [ 1033.729672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.729800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.729867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.730101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.730716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.730716] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.730716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.730716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.730716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.730716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.731137] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.731137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.731137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.731355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.731355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.731355] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48c0fd61-715a-44ba-a067-7f81fec3e727 is going to be updated. [ 1033.752750] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.752945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.752945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.753176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.753325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.753484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48c0fd61-715a-44ba-a067-7f81fec3e727" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.009749] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1034.009986] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 1034.009986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.010178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.010401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.010585] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.010715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.010781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.010943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.011052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.011128] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.513524] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.934917] env[66157]: INFO networking_nsxv3.common.synchronization [None req-8d5c98e3-ffef-424c-ab2b-2aa80f32b8ae tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_rules [ 1034.935546] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_rules [ 1034.936107] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.936490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.936490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.936956] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.937089] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.019893] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.048412] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f13b0831-ad08-4520-aa57-76bf03b53069 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_rules [ 1035.049299] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_rules [ 1035.049762] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.049899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.505216] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.506034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.506034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.506034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.506034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.506263] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 already deleted. [ 1035.506296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.506522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.506732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.506826] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.525070] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.525070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.525070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.525070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.525070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.525070] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1035.560213] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.560213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.560213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.560213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.560804] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.571944] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1036.030832] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.030832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.030832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.030832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.030832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.030832] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 already deleted. [ 1036.030832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.272270] env[66157]: INFO networking_nsxv3.common.synchronization [None req-756e7aba-ebbf-47fa-838e-ff6dbe751288 None None] Enqueued Resource ID: 77604ed8-7590-44a9-89df-a826962d0a37 with Priority: HIGHEST for action port [ 1036.272822] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77604ed8-7590-44a9-89df-a826962d0a37 with Priority: HIGHEST for action port [ 1036.273343] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-77604ed8-7590-44a9-89df-a826962d0a37 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.273343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77604ed8-7590-44a9-89df-a826962d0a37" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.273343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77604ed8-7590-44a9-89df-a826962d0a37" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.273520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77604ed8-7590-44a9-89df-a826962d0a37" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.273520] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77604ed8-7590-44a9-89df-a826962d0a37',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.776677] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77604ed8-7590-44a9-89df-a826962d0a37 [ 1036.777066] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.778109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.778109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.778109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.778109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.778109] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77604ed8-7590-44a9-89df-a826962d0a37 already deleted. [ 1036.778109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77604ed8-7590-44a9-89df-a826962d0a37" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.290491] env[66157]: INFO networking_nsxv3.common.synchronization [None req-4e064b76-fbb5-4b68-9213-e1e35a0f8dc3 tempest-ServerActionsTestOtherB-552517833 tempest-ServerActionsTestOtherB-552517833-project-member] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1037.291021] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1037.291495] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.291495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.291659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.291787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.291855] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.452432] env[66157]: INFO networking_nsxv3.common.synchronization [None req-d0c2a6be-5e9c-4fa9-a807-5647a2387a7b tempest-ServerActionsTestOtherB-552517833 tempest-ServerActionsTestOtherB-552517833-project-member] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1037.453091] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1037.453530] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.453530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.582553] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1037.583910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.583910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.583910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.583910] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.583910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.583910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.583910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.583910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.584655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.584655] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.815281] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.815435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.815504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.815742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.815844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.815958] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a already deleted. [ 1037.816044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.816821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.816821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.816821] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.089327] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.089415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.089454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.089872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.089872] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.092783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.092783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.092783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.092783] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.351629] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.352178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.352178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.352178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.352316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.352364] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a already deleted. [ 1038.353242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.596619] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94: rpc.has_security_group_logging(os_id): False [ 1038.616314] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.616314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.616314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.616314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.616314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.616314] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.616314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.616314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.617149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.617149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.617149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.617149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.617149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.617350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.617350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.617479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.617534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.617622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.617921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.619096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.619369] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1038.686219] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.686219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.686219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.686219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.686219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.703192] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1039.272201] env[66157]: INFO networking_nsxv3.common.synchronization [None req-87b46108-59c5-4bc3-97b5-11e75acdccaa None None] Enqueued Resource ID: 37666582-fed2-4aee-884d-46a1c90c45ae with Priority: HIGHEST for action port [ 1039.272546] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37666582-fed2-4aee-884d-46a1c90c45ae with Priority: HIGHEST for action port [ 1039.273516] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-37666582-fed2-4aee-884d-46a1c90c45ae taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.273516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37666582-fed2-4aee-884d-46a1c90c45ae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.273516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37666582-fed2-4aee-884d-46a1c90c45ae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.273735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37666582-fed2-4aee-884d-46a1c90c45ae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.273773] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37666582-fed2-4aee-884d-46a1c90c45ae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.776531] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37666582-fed2-4aee-884d-46a1c90c45ae [ 1039.776854] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.776919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.776958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.777261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.777352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.777497] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37666582-fed2-4aee-884d-46a1c90c45ae already deleted. [ 1039.777599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37666582-fed2-4aee-884d-46a1c90c45ae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.514966] env[66157]: INFO networking_nsxv3.common.synchronization [None req-9a5e6d83-97b5-4376-ab4a-42387a870929 None None] Enqueued Resource ID: b32c8e83-d534-4a95-97db-26d4b8e21bf5 with Priority: HIGHEST for action port [ 1040.515685] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b32c8e83-d534-4a95-97db-26d4b8e21bf5 with Priority: HIGHEST for action port [ 1040.516485] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b32c8e83-d534-4a95-97db-26d4b8e21bf5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.516620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b32c8e83-d534-4a95-97db-26d4b8e21bf5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.516688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b32c8e83-d534-4a95-97db-26d4b8e21bf5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.516934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b32c8e83-d534-4a95-97db-26d4b8e21bf5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.517036] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b32c8e83-d534-4a95-97db-26d4b8e21bf5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.720860] env[66157]: INFO networking_nsxv3.common.synchronization [req-875288d5-bc73-4868-a936-8acd37af3ce4 req-3ebc1a39-54a1-4829-a3b3-dfd35db2b97e tempest-ServerTagsTestJSON-1189778374 tempest-ServerTagsTestJSON-1189778374-project-member] Enqueued Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGHEST for action security_group_members [ 1040.721904] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGHEST for action security_group_members [ 1040.723262] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f8f8d4-52f2-44d4-ac27-8664220f43ee taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.723262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.723262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.723262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.723476] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.723534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.723622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.723743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.723824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.723916] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.725968] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1040.726176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.023037] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b32c8e83-d534-4a95-97db-26d4b8e21bf5 [ 1041.023037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.023037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.023037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.023037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.023037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.023037] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b32c8e83-d534-4a95-97db-26d4b8e21bf5 already deleted. [ 1041.023037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b32c8e83-d534-4a95-97db-26d4b8e21bf5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.154824] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-784 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.155030] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.155155] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.155480] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.155887] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.156062] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.156179] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.156430] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.156588] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.156925] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.156925] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.157024] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.157124] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.157232] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.157335] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.157485] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.179435] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.179435] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.179435] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.179737] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.179819] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-be116b5b-0b67-4610-bf8d-6d27531d8b36 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.179994] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-be116b5b-0b67-4610-bf8d-6d27531d8b36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.180127] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-be116b5b-0b67-4610-bf8d-6d27531d8b36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.180466] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-be116b5b-0b67-4610-bf8d-6d27531d8b36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.180605] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be116b5b-0b67-4610-bf8d-6d27531d8b36',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.228045] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.228485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.228584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.229480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.229480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.229480] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.229653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.229692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.231040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.231040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.231040] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee already deleted. [ 1041.231040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.682964] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.683262] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.683408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.683711] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.683867] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.685032] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port be116b5b-0b67-4610-bf8d-6d27531d8b36 not found, creating... [ 1041.685032] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.685032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.685032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.685032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.685032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.685343] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.686028] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.686028] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.686028] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.686028] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.686028] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: be116b5b-0b67-4610-bf8d-6d27531d8b36 is going to be created. [ 1041.712690] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.712924] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.713065] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.713343] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.713575] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.713794] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-be116b5b-0b67-4610-bf8d-6d27531d8b36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.420875] env[66157]: INFO networking_nsxv3.common.synchronization [req-875288d5-bc73-4868-a936-8acd37af3ce4 req-50c2843c-e39c-451b-a0e7-d578d2f4b559 service nova] Enqueued Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGHEST for action security_group_rules [ 1042.421357] env[66157]: INFO networking_nsxv3.common.synchronization [req-875288d5-bc73-4868-a936-8acd37af3ce4 req-50c2843c-e39c-451b-a0e7-d578d2f4b559 service nova] Enqueued Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGHEST for action security_group_members [ 1042.421357] env[66157]: INFO networking_nsxv3.common.synchronization [req-875288d5-bc73-4868-a936-8acd37af3ce4 req-50c2843c-e39c-451b-a0e7-d578d2f4b559 service nova] Enqueued Resource ID: be116b5b-0b67-4610-bf8d-6d27531d8b36 with Priority: HIGHEST for action port [ 1042.421851] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGHEST for action security_group_rules [ 1042.421948] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGHEST for action security_group_members [ 1042.422837] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be116b5b-0b67-4610-bf8d-6d27531d8b36 with Priority: HIGHEST for action port [ 1042.423222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.423410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.423724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.424048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.424232] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.425196] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f8f8d4-52f2-44d4-ac27-8664220f43ee taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.425504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.425504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.425778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.425974] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.426137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.426237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.426480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.426611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.430061] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.430061] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-be116b5b-0b67-4610-bf8d-6d27531d8b36 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.430061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be116b5b-0b67-4610-bf8d-6d27531d8b36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.430061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be116b5b-0b67-4610-bf8d-6d27531d8b36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.430061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be116b5b-0b67-4610-bf8d-6d27531d8b36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.430061] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be116b5b-0b67-4610-bf8d-6d27531d8b36',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.485222] env[66157]: INFO networking_nsxv3.common.synchronization [None req-4c14cf76-1a4b-49ba-964b-ca96d71a5dd3 None None] Enqueued Resource ID: cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9 with Priority: HIGHEST for action port [ 1042.485222] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9 with Priority: HIGHEST for action port [ 1042.485685] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.486567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.486778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.487311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.487536] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.930812] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f8f8d4-52f2-44d4-ac27-8664220f43ee taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.930812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.933583] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.934560] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be116b5b-0b67-4610-bf8d-6d27531d8b36 with status ACTIVE [ 1042.934768] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.934903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.934976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.935191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.935281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.935465] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.935561] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.935621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.935769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.935844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.936058] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.936165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.936249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.937163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.937260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.937438] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be116b5b-0b67-4610-bf8d-6d27531d8b36 is going to be updated. [ 1042.961942] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.962744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.962744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.962744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.962744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.962744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be116b5b-0b67-4610-bf8d-6d27531d8b36" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.991182] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9 [ 1042.991182] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.991182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.991182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.991182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.991400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.991400] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9 already deleted. [ 1042.991460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb4b8fa3-f0de-41e4-9efe-5c454bcf4ee9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.060372] env[66157]: INFO networking_nsxv3.common.synchronization [None req-097cb0b9-443a-4746-ba11-1bbc9c83553a None None] Enqueued Resource ID: 4b73ec64-68f7-4fc3-8f72-c95641a0b696 with Priority: HIGHEST for action port [ 1043.061229] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b73ec64-68f7-4fc3-8f72-c95641a0b696 with Priority: HIGHEST for action port [ 1043.061311] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b73ec64-68f7-4fc3-8f72-c95641a0b696 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.063408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b73ec64-68f7-4fc3-8f72-c95641a0b696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.063408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b73ec64-68f7-4fc3-8f72-c95641a0b696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.063408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b73ec64-68f7-4fc3-8f72-c95641a0b696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.063408] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b73ec64-68f7-4fc3-8f72-c95641a0b696',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.440842] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.563953] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b73ec64-68f7-4fc3-8f72-c95641a0b696 [ 1043.564208] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.564606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.564606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.565171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.565171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.565171] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b73ec64-68f7-4fc3-8f72-c95641a0b696 already deleted. [ 1043.565171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b73ec64-68f7-4fc3-8f72-c95641a0b696" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.644790] env[66157]: INFO networking_nsxv3.common.synchronization [None req-613cad35-ff8e-4fd7-89b7-342479ee8d33 tempest-ServersTestFqdnHostnames-1310601545 tempest-ServersTestFqdnHostnames-1310601545-project-member] Enqueued Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_rules [ 1043.645343] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_rules [ 1043.645672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4120ed87-fb96-4685-aabd-90a91df342cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.645794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.645859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.646121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.646202] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.797758] env[66157]: INFO networking_nsxv3.common.synchronization [None req-891fe2e1-a9f9-4e76-874f-00ef2abeb95b tempest-ServersTestFqdnHostnames-1310601545 tempest-ServersTestFqdnHostnames-1310601545-project-member] Enqueued Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_rules [ 1043.797758] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_rules [ 1043.797758] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4120ed87-fb96-4685-aabd-90a91df342cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.798098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.943851] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.944036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.944092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.944319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.945133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.945485] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee is going to be created. [ 1043.970311] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.970443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.970509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.970911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.972128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.984346] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee in Status: UNINITIALIZED for 2s [ 1044.167394] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.167660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.167745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.168055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.168055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.168160] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4120ed87-fb96-4685-aabd-90a91df342cd already deleted. [ 1044.168254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.168330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.168480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.168568] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.693175] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.693766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.693766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.693766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.693918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.693918] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4120ed87-fb96-4685-aabd-90a91df342cd already deleted. [ 1044.694016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.896505] env[66157]: INFO networking_nsxv3.common.synchronization [None req-caf6b909-5122-4764-ac64-c1178db4dbd7 None None] Enqueued Resource ID: 833a8201-59f2-470c-8780-75f725a4403b with Priority: HIGHEST for action port [ 1044.897029] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833a8201-59f2-470c-8780-75f725a4403b with Priority: HIGHEST for action port [ 1044.897403] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-833a8201-59f2-470c-8780-75f725a4403b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.897521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-833a8201-59f2-470c-8780-75f725a4403b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.897589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-833a8201-59f2-470c-8780-75f725a4403b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.897839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-833a8201-59f2-470c-8780-75f725a4403b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.897921] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('833a8201-59f2-470c-8780-75f725a4403b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.190239] env[66157]: INFO networking_nsxv3.common.synchronization [req-639af723-d413-4d6d-953b-ae91445ad2b6 req-ec808453-be9f-489a-a9c7-0771767c637e tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1045.191019] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1045.191439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.191621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.192232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.192232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.192413] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.192542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.193854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.193854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.193854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.193854] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.400574] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 833a8201-59f2-470c-8780-75f725a4403b [ 1045.401909] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.401909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.401909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.401909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.401909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.401909] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:833a8201-59f2-470c-8780-75f725a4403b already deleted. [ 1045.401909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-833a8201-59f2-470c-8780-75f725a4403b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.553900] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1045.554150] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:2 started [ 1045.559705] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.559834] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.559908] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.560353] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.560547] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.560671] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.560785] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.560999] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.561448] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.561448] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.561554] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.561637] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.561843] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.561970] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.562078] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.562893] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.592929] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.593182] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1045.593955] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.593955] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.593955] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-593219b8-a84d-483e-8900-f80df60f9446 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.594280] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-593219b8-a84d-483e-8900-f80df60f9446" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.594468] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-593219b8-a84d-483e-8900-f80df60f9446" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.594805] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-593219b8-a84d-483e-8900-f80df60f9446" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.594945] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593219b8-a84d-483e-8900-f80df60f9446',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.695049] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.994585] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee in Status: SUCCESS [ 1045.994826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.995088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.995361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.995585] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.995744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.995832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.996047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.996168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.996284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.996377] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.097743] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.097900] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.098155] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.098960] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.098960] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.098960] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 593219b8-a84d-483e-8900-f80df60f9446 not found, creating... [ 1046.098960] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.099198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.099242] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.099440] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.099574] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.099860] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.100011] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.100126] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.100337] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.101372] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.101372] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 593219b8-a84d-483e-8900-f80df60f9446 is going to be created. [ 1046.122311] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.122534] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.122657] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.122919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.123176] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.123570] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-593219b8-a84d-483e-8900-f80df60f9446" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.198958] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.498977] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f8f8d4-52f2-44d4-ac27-8664220f43ee taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.499293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.499293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.499562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.499724] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.499835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.499904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.500099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.500202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.500321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.500675] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f8f8d4-52f2-44d4-ac27-8664220f43ee taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.500675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.500675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.500936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.500974] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.501056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.501120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.501283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.501372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.501472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.501569] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.702449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.702449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.704905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.704905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.704905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.704905] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1046.741173] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.741357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.741357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.741590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.741767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.752560] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1046.883923] env[66157]: INFO networking_nsxv3.common.synchronization [req-639af723-d413-4d6d-953b-ae91445ad2b6 req-bbbb80a3-5311-486b-a77e-91fb0fe34ed4 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 1046.884196] env[66157]: INFO networking_nsxv3.common.synchronization [req-639af723-d413-4d6d-953b-ae91445ad2b6 req-bbbb80a3-5311-486b-a77e-91fb0fe34ed4 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1046.884320] env[66157]: INFO networking_nsxv3.common.synchronization [req-639af723-d413-4d6d-953b-ae91445ad2b6 req-bbbb80a3-5311-486b-a77e-91fb0fe34ed4 service nova] Enqueued Resource ID: 593219b8-a84d-483e-8900-f80df60f9446 with Priority: HIGHEST for action port [ 1046.885259] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 1046.885412] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1046.885510] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593219b8-a84d-483e-8900-f80df60f9446 with Priority: HIGHEST for action port [ 1046.885848] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.886621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.886621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.886621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.886621] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.887964] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.888107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.888380] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-593219b8-a84d-483e-8900-f80df60f9446 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.888493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-593219b8-a84d-483e-8900-f80df60f9446" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.888559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-593219b8-a84d-483e-8900-f80df60f9446" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.888749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-593219b8-a84d-483e-8900-f80df60f9446" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.888854] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593219b8-a84d-483e-8900-f80df60f9446',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.004382] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54f8f8d4-52f2-44d4-ac27-8664220f43ee: rpc.has_security_group_logging(os_id): False [ 1047.024784] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.024949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.025045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.025271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.025365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.025564] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.025660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.025718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.025858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.025933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.026150] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.026262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.026329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.026464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.026538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.026726] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.026818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.026875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.027015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.027094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.027199] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee is going to be created. [ 1047.112304] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.112545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.112661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.112903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.113121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.126955] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee in Status: IN_PROGRESS for 2s [ 1047.391151] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.391151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.393472] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 593219b8-a84d-483e-8900-f80df60f9446 with status ACTIVE [ 1047.395069] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.395069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.395069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.395069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.395069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.395378] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.395552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.395552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.395626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.395722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.395879] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.395966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.396046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.396258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.396348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.396415] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 593219b8-a84d-483e-8900-f80df60f9446 is going to be updated. [ 1047.420082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.420082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.420210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.420325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.420468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.420622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-593219b8-a84d-483e-8900-f80df60f9446" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.730541] env[66157]: INFO networking_nsxv3.common.synchronization [req-e94e8aa7-c5c7-4ebf-8c12-fe98b2c61883 req-52750775-ba0f-4ad2-92a7-2a4a91f098fd tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 1047.730541] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 1047.731392] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.731392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.731392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.731392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.731548] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.731548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.731622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.731745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.731849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.731935] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.052401] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.052618] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.052702] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.052964] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.053231] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.053394] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.053501] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.053751] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.053944] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.054194] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.054308] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.054518] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.054888] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.054888] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.055082] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.055305] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.076228] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.076507] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.076575] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.076732] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-800" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.077056] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.077296] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.077384] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.077710] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.077848] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16400ef-eaa3-4d70-8a6a-b499d13adbb0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.234634] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.234885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.234885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.235168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.235251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.235484] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.235618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.235663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.235848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.235925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.236025] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 1048.267377] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.267549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.267636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.267831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.267980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.278086] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 1048.580358] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.580620] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.580684] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.581024] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.581183] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.581339] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port d16400ef-eaa3-4d70-8a6a-b499d13adbb0 not found, creating... [ 1048.581602] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.581768] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.581886] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.582313] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.582452] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.582761] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.582894] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.583015] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.583231] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.583364] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.583508] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: d16400ef-eaa3-4d70-8a6a-b499d13adbb0 is going to be created. [ 1048.603464] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.603786] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.603969] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.604318] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.604565] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.604785] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.763061] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1048.763472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.763943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.764238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.764444] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.764594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.764656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.764873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.764953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.765095] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.144163] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee in Status: SUCCESS [ 1049.144315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.267121] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.377012] env[66157]: INFO networking_nsxv3.common.synchronization [req-e94e8aa7-c5c7-4ebf-8c12-fe98b2c61883 req-7843173a-22c6-436b-9209-9d1cf024e44e service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 1049.377499] env[66157]: INFO networking_nsxv3.common.synchronization [req-e94e8aa7-c5c7-4ebf-8c12-fe98b2c61883 req-7843173a-22c6-436b-9209-9d1cf024e44e service nova] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 1049.377675] env[66157]: INFO networking_nsxv3.common.synchronization [req-e94e8aa7-c5c7-4ebf-8c12-fe98b2c61883 req-7843173a-22c6-436b-9209-9d1cf024e44e service nova] Enqueued Resource ID: d16400ef-eaa3-4d70-8a6a-b499d13adbb0 with Priority: HIGHEST for action port [ 1049.378635] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_rules [ 1049.378844] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 1049.379067] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16400ef-eaa3-4d70-8a6a-b499d13adbb0 with Priority: HIGHEST for action port [ 1049.379383] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.379584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.379691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.379943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.380104] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.382137] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.382137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.382407] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.382559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.382660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.382886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.383019] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16400ef-eaa3-4d70-8a6a-b499d13adbb0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.769981] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.883110] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.883294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.885652] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d16400ef-eaa3-4d70-8a6a-b499d13adbb0 with status ACTIVE [ 1049.885847] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.885987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.886071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.886305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.886391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.886569] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.886660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.886718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.886860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.886946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.887158] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.887272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.887385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.887460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.887540] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.887620] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d16400ef-eaa3-4d70-8a6a-b499d13adbb0 is going to be updated. [ 1049.909673] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.909835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.909904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.910122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.910252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.910407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d16400ef-eaa3-4d70-8a6a-b499d13adbb0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.272527] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.272722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.272941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.273037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.273204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.273255] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1050.296037] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 1050.296037] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 1050.296037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.296037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.296037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.296037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.296037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.296037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.296037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.296037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.296037] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.310316] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.310316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.310316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.310316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.311594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.322350] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1050.796789] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.299738] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.802953] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.803301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.803417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.803718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.803833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.803989] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 1051.846462] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.846631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.846710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.846939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.847214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.858143] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 1052.340799] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1052.341164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.341399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.341762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.342093] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.342323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.342323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.342748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.342748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.342748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.342918] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.845613] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.845958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.845958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.846709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.846894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.847016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.847093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.847251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.847336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.847425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.847604] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.847665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.847722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.847859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.848030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.848145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.848207] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.848344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.848420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.848500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.848588] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.350653] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 1053.372240] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.372240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.372483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.372521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.372601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.372801] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.372894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.372960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.373125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.373203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.373408] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.373505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.373556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.373827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.373827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.373931] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.374656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.374836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.375122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.375458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.375619] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1053.472255] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.472537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.472537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.472809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.472969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.495296] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1053.872241] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 1053.874832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.874832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.874832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.874832] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.874832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.874832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.874832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.874832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.874832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.875191] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.378096] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.378096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.378096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.378437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.378478] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.378567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.378631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.378764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.378989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.378989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.379120] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.379194] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.379252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.379383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.379516] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.379604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.379668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.379809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.379888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.379968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.380102] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.381016] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1054.381292] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1054.884383] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7e2acfe-17af-4683-bd94-9fc47ded2886: rpc.has_security_group_logging(os_id): False [ 1054.907202] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.907202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.907202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.907202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.907202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.907463] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.907519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.907640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.907772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.907893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.908194] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.908317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.909404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.909404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.909404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.909404] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.909404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.909404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.909404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.909404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.909404] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 1055.000429] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.000632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.000676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.000864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.001078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.025840] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 1055.175024] env[66157]: INFO networking_nsxv3.common.synchronization [req-88724e78-211a-4409-b164-d0e035f54d3f req-625f98da-7c64-45f4-81e1-ea75e055c654 tempest-ServerTagsTestJSON-1189778374 tempest-ServerTagsTestJSON-1189778374-project-member] Enqueued Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGHEST for action security_group_members [ 1055.175689] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGHEST for action security_group_members [ 1055.176106] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f8f8d4-52f2-44d4-ac27-8664220f43ee taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.176316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.176316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.177078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.177078] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.177078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.177078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.177377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.177377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.177377] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.278932] env[66157]: INFO networking_nsxv3.common.synchronization [None req-2aa34516-4133-40c0-b305-902f76ae3851 None None] Enqueued Resource ID: e0672dab-6bba-4ae6-873a-c4280ae428c1 with Priority: HIGHEST for action port [ 1055.279562] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0672dab-6bba-4ae6-873a-c4280ae428c1 with Priority: HIGHEST for action port [ 1055.279902] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0672dab-6bba-4ae6-873a-c4280ae428c1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.280611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0672dab-6bba-4ae6-873a-c4280ae428c1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.281371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0672dab-6bba-4ae6-873a-c4280ae428c1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.281764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0672dab-6bba-4ae6-873a-c4280ae428c1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.281877] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0672dab-6bba-4ae6-873a-c4280ae428c1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.513049] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1055.513793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.679788] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.679965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.680046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.681741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.681741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.681741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.681741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.681741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.681741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.681741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.681741] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee is going to be updated. [ 1055.686768] env[66157]: INFO networking_nsxv3.common.synchronization [req-e334a855-fa41-450c-b3c3-7dd2fc2b6d6b req-6fb0ac56-4151-486d-8337-3503219d1843 tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_members [ 1055.687972] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGHEST for action security_group_members [ 1055.688339] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bb5a370-76e0-4d7c-9a46-84239200c704 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.688479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.688545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.688730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.688885] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.689032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.689095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.689186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.689271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.689365] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.728192] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.728862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.729228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.729798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.730625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.745944] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee in Status: IN_PROGRESS for 2s [ 1055.784620] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0672dab-6bba-4ae6-873a-c4280ae428c1 [ 1055.784866] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.785064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.785129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.785307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.785395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.785496] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0672dab-6bba-4ae6-873a-c4280ae428c1 already deleted. [ 1055.785575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0672dab-6bba-4ae6-873a-c4280ae428c1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.191786] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.192137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.192666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.193211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.216830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.216970] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.217585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.217681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.217864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.217943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.218234] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 is going to be updated. [ 1056.250408] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.250408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.250408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.250408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.250408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.263132] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 in Status: IN_PROGRESS for 2s [ 1056.381013] env[66157]: INFO networking_nsxv3.common.synchronization [None req-e787c6d9-1d52-4846-a741-326b697fca6b tempest-AttachVolumeTestJSON-1599628970 tempest-AttachVolumeTestJSON-1599628970-project-member] Enqueued Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_rules [ 1056.388566] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_rules [ 1056.388566] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.388566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.388566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.388566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.388566] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.547536] env[66157]: INFO networking_nsxv3.common.synchronization [None req-6b13a543-015c-48e7-82e0-dfc5b307f156 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_rules [ 1056.548545] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_rules [ 1056.549363] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe07656-65ae-471b-953b-0e7810aed7b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.549363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.549363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.549634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.549805] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.582926] env[66157]: INFO networking_nsxv3.common.synchronization [None req-18772a35-165f-48d4-aa3a-117c5417a1cb tempest-AttachVolumeTestJSON-1599628970 tempest-AttachVolumeTestJSON-1599628970-project-member] Enqueued Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_rules [ 1056.583323] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_rules [ 1056.583488] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.584115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.724386] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0160e3b1-536d-4d97-815c-3ef3415708b0 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_rules [ 1056.725269] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_rules [ 1056.725472] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe07656-65ae-471b-953b-0e7810aed7b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.725472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.918486] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.918766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.918865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.919471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.919471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.919471] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a already deleted. [ 1056.919654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.920201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.920447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.920447] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.047045] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 1057.047348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.074514] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.074787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.074787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.075107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.075107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.075107] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe07656-65ae-471b-953b-0e7810aed7b9 already deleted. [ 1057.075377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.075913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.075913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.076170] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.086804] env[66157]: INFO networking_nsxv3.common.synchronization [req-ab815890-3b88-4533-9b37-ba5c0acfc4e9 req-937dacfd-f4ca-40f2-af06-ebeb9c94699e tempest-ServerActionsV293TestJSON-294038275 tempest-ServerActionsV293TestJSON-294038275-project-member] Enqueued Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_members [ 1057.088751] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_members [ 1057.088751] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.088751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.088751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.088751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.088751] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.088751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.088751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.088751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.088751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.089275] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.443865] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.444272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.444272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.444373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.444441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.444672] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a already deleted. [ 1057.444790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.591740] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-461 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.591740] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-461" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.591740] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-461" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.591740] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-461" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.591740] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.595139] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.595410] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.595720] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.595862] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.596129] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.596243] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.596349] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.596456] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.596559] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.596659] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.596788] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.598398] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.598522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.598579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.598778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.598868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.602203] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.602385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.602436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.603810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.603810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.603810] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d already deleted. [ 1057.603810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.604051] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.604051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.604145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.604244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.604320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.604403] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe07656-65ae-471b-953b-0e7810aed7b9 already deleted. [ 1057.604477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.625690] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.626144] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.626232] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.626396] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-461" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.626703] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-bfe48557-6ad9-4e95-8a90-328226b288cd taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.626894] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-bfe48557-6ad9-4e95-8a90-328226b288cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.627030] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-bfe48557-6ad9-4e95-8a90-328226b288cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.627986] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-bfe48557-6ad9-4e95-8a90-328226b288cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.627986] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfe48557-6ad9-4e95-8a90-328226b288cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.758843] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee in Status: SUCCESS [ 1057.759096] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee deletion is rescheduled due to dependency. [ 1057.759224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.907767] env[66157]: INFO networking_nsxv3.common.synchronization [None req-f094ed9e-f442-4940-8ad5-ea7ce10f892e None None] Enqueued Resource ID: de162bf2-f81b-4653-aa11-ee8f092009cf with Priority: HIGHEST for action port [ 1057.909254] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de162bf2-f81b-4653-aa11-ee8f092009cf with Priority: HIGHEST for action port [ 1057.909254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-de162bf2-f81b-4653-aa11-ee8f092009cf taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.909254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de162bf2-f81b-4653-aa11-ee8f092009cf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.909482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de162bf2-f81b-4653-aa11-ee8f092009cf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.909573] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de162bf2-f81b-4653-aa11-ee8f092009cf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.909653] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de162bf2-f81b-4653-aa11-ee8f092009cf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.130385] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.130625] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.130752] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.131050] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.131210] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.131367] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port bfe48557-6ad9-4e95-8a90-328226b288cd not found, creating... [ 1058.131672] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.131834] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.131953] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.132225] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.132369] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.132596] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.132754] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.132862] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.133095] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.133248] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.133388] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: bfe48557-6ad9-4e95-8a90-328226b288cd is going to be created. [ 1058.158656] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.158897] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.159049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.160270] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.160270] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.160270] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-bfe48557-6ad9-4e95-8a90-328226b288cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.275750] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 in Status: SUCCESS [ 1058.276147] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 deletion is rescheduled due to dependency. [ 1058.276307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.411776] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de162bf2-f81b-4653-aa11-ee8f092009cf [ 1058.411995] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.412163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.412270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.412971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.413136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.413207] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de162bf2-f81b-4653-aa11-ee8f092009cf already deleted. [ 1058.413283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de162bf2-f81b-4653-aa11-ee8f092009cf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.891636] env[66157]: INFO networking_nsxv3.common.synchronization [req-ab815890-3b88-4533-9b37-ba5c0acfc4e9 req-1ca6622f-4e7c-4fe8-9f91-793a0aaf0b7a service nova] Enqueued Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_rules [ 1058.891636] env[66157]: INFO networking_nsxv3.common.synchronization [req-ab815890-3b88-4533-9b37-ba5c0acfc4e9 req-1ca6622f-4e7c-4fe8-9f91-793a0aaf0b7a service nova] Enqueued Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_members [ 1058.891993] env[66157]: INFO networking_nsxv3.common.synchronization [req-ab815890-3b88-4533-9b37-ba5c0acfc4e9 req-1ca6622f-4e7c-4fe8-9f91-793a0aaf0b7a service nova] Enqueued Resource ID: bfe48557-6ad9-4e95-8a90-328226b288cd with Priority: HIGHEST for action port [ 1058.892303] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_rules [ 1058.892447] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_members [ 1058.892537] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfe48557-6ad9-4e95-8a90-328226b288cd with Priority: HIGHEST for action port [ 1058.893188] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.893188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.893188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.893405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.893405] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.894382] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.894634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.894831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.895028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.895748] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.895913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.895989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.896363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.896363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.896465] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.899035] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfe48557-6ad9-4e95-8a90-328226b288cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.899162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfe48557-6ad9-4e95-8a90-328226b288cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.899231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfe48557-6ad9-4e95-8a90-328226b288cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.899402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfe48557-6ad9-4e95-8a90-328226b288cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.899480] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfe48557-6ad9-4e95-8a90-328226b288cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.237290] env[66157]: INFO networking_nsxv3.common.synchronization [req-aec18ecf-cb04-490b-a956-96c2da6fb13a req-567d1aac-a01a-451d-8ddc-bc56801c6cba tempest-ServerRescueNegativeTestJSON-2006998581 tempest-ServerRescueNegativeTestJSON-2006998581-project-member] Enqueued Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_members [ 1059.237290] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGHEST for action security_group_members [ 1059.237290] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-099cf4d4-ded3-44df-b6e7-328bc3763be6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.237290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.237290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.237793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.238146] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.238464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.238661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.239016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.240700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.240700] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.315157] env[66157]: INFO networking_nsxv3.common.synchronization [req-ad48a966-32ac-41fa-b9cb-75ac109cbdd9 req-40fc4258-03ba-4ed8-9345-001cc861e6ab tempest-ServersNegativeTestJSON-423798559 tempest-ServersNegativeTestJSON-423798559-project-member] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1059.315157] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1059.315157] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.315999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.316209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.316537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.316793] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.317041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.317213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.317483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.317664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.317861] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.401614] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.401877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.407152] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.408035] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfe48557-6ad9-4e95-8a90-328226b288cd with status ACTIVE [ 1059.408312] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.408422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.408482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.408694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.408785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.408966] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.409078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.409138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.409288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.409362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.409541] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.409631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.409691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.409827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.409900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.409983] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfe48557-6ad9-4e95-8a90-328226b288cd is going to be updated. [ 1059.433526] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.433526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.433526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.433526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.433526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.433960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfe48557-6ad9-4e95-8a90-328226b288cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.741977] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.742180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.742254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.742493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.766390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.766684] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.766821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.766901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.767187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.767269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.767327] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 is going to be updated. [ 1059.782624] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.782838] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.782969] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.783348] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.783877] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.784093] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.784194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.784466] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.784633] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.784871] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.785070] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.785139] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.785233] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.785344] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.785466] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.785582] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.800479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.800713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.800713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.800960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.801047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.808746] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.808983] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.809165] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.809371] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.809557] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.810213] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.810763] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.810858] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.810942] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.812943] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 in Status: IN_PROGRESS for 2s [ 1059.819650] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.912863] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.314184] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.314467] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.314560] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.314820] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.314975] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.315156] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3 not found, creating... [ 1060.315435] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.315600] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.315718] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.315998] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.316150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.316448] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.316601] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.316837] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.316923] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.317186] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.317380] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3 is going to be created. [ 1060.322226] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.356366] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.356581] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.356705] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.357034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.357284] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.357514] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.415283] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.415449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.415696] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.415735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.415860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.415968] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d is going to be created. [ 1060.457178] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.457178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.457178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.457537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.457537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.477583] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d in Status: UNINITIALIZED for 2s [ 1060.824803] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.825041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.825127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.825348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.825450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.825546] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be updated. [ 1060.865942] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.865942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.865942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.865942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.865942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.876642] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1061.100721] env[66157]: INFO networking_nsxv3.common.synchronization [req-ad48a966-32ac-41fa-b9cb-75ac109cbdd9 req-65dfeb6d-09da-425d-8665-c12b7f7ecc09 service nova] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_rules [ 1061.100721] env[66157]: INFO networking_nsxv3.common.synchronization [req-ad48a966-32ac-41fa-b9cb-75ac109cbdd9 req-65dfeb6d-09da-425d-8665-c12b7f7ecc09 service nova] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1061.100721] env[66157]: INFO networking_nsxv3.common.synchronization [req-ad48a966-32ac-41fa-b9cb-75ac109cbdd9 req-65dfeb6d-09da-425d-8665-c12b7f7ecc09 service nova] Enqueued Resource ID: 432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3 with Priority: HIGHEST for action port [ 1061.102112] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_rules [ 1061.103112] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1061.104055] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3 with Priority: HIGHEST for action port [ 1061.104055] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.104055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.104055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.104055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.104312] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.105741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.105741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.105741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.105741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.105741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.106033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.106033] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.609166] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.609346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.614341] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3 with status ACTIVE [ 1061.614341] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.614341] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.614341] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.614634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.614803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.615013] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.615132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.615175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.615395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.615470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.615656] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.617837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.617837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.617837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.617837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.617837] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3 is going to be updated. [ 1061.641426] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.641678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.641761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.642066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.642321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.642591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-432c4fa4-6b43-4f2e-85c3-d2ce3c14a6b3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.829089] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 in Status: SUCCESS [ 1061.829747] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 deletion is rescheduled due to dependency. [ 1061.829747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.852785] env[66157]: INFO networking_nsxv3.common.synchronization [req-3f06cd25-e31e-4917-b094-f4bcdff723d5 req-eb4a69ff-5a3f-4183-a458-8d1d9eac7696 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_members [ 1061.853475] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_members [ 1061.853882] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.854102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.854230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.854498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.854692] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.854819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.854903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.855123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.855277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.855423] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.219662] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.220078] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.220078] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.220268] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.220530] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.220692] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.220802] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.221115] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.221302] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.221509] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.221624] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.221906] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.222051] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.222182] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.222289] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.222424] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.245231] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.245412] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.245555] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.245798] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.246171] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-4782c2a6-1bbe-439a-8ca0-a877a025980f taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.246352] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-4782c2a6-1bbe-439a-8ca0-a877a025980f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.246471] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-4782c2a6-1bbe-439a-8ca0-a877a025980f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.246855] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-4782c2a6-1bbe-439a-8ca0-a877a025980f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.246992] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4782c2a6-1bbe-439a-8ca0-a877a025980f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.358140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.358406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.358406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.358670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.358847] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.358967] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.359090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.359134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.359294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.359369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.359487] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 already deleted. [ 1062.359553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.495236] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d in Status: SUCCESS [ 1062.495587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.496260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.496564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.496838] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.497149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.497300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.498298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.498454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.498607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.498754] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.750238] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.752668] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.752726] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.753035] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.753210] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.753371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 4782c2a6-1bbe-439a-8ca0-a877a025980f not found, creating... [ 1062.753815] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.754017] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.754144] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.754401] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.754769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.754861] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.755143] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.755143] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.755440] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.755590] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.755780] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 4782c2a6-1bbe-439a-8ca0-a877a025980f is going to be created. [ 1062.782626] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.783056] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.783149] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.783597] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.783904] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.784171] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-4782c2a6-1bbe-439a-8ca0-a877a025980f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.895958] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1062.895958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.895958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.895958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.895958] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.895958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.895958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.895958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.895958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.895958] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.003546] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.399346] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.506466] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d: rpc.has_security_group_logging(os_id): False [ 1063.527899] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.529719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.530020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.530347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.530860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.534104] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.534795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.534795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.534795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.536692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.536692] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d is going to be created. [ 1063.548644] env[66157]: INFO networking_nsxv3.common.synchronization [req-3f06cd25-e31e-4917-b094-f4bcdff723d5 req-74603246-89dc-4456-9cb1-606cb8d6c260 service nova] Enqueued Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_rules [ 1063.549240] env[66157]: INFO networking_nsxv3.common.synchronization [req-3f06cd25-e31e-4917-b094-f4bcdff723d5 req-74603246-89dc-4456-9cb1-606cb8d6c260 service nova] Enqueued Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_members [ 1063.549505] env[66157]: INFO networking_nsxv3.common.synchronization [req-3f06cd25-e31e-4917-b094-f4bcdff723d5 req-74603246-89dc-4456-9cb1-606cb8d6c260 service nova] Enqueued Resource ID: 4782c2a6-1bbe-439a-8ca0-a877a025980f with Priority: HIGHEST for action port [ 1063.550181] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_rules [ 1063.551084] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_members [ 1063.554190] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4782c2a6-1bbe-439a-8ca0-a877a025980f with Priority: HIGHEST for action port [ 1063.554190] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.554190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.554190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.554190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.554190] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.554190] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.554190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.554190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.559858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.559858] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.559858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.559858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.559858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.559858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.559858] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.562258] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-4782c2a6-1bbe-439a-8ca0-a877a025980f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.562930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4782c2a6-1bbe-439a-8ca0-a877a025980f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.563057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4782c2a6-1bbe-439a-8ca0-a877a025980f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.563253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4782c2a6-1bbe-439a-8ca0-a877a025980f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.563372] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4782c2a6-1bbe-439a-8ca0-a877a025980f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.602696] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.602885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.602927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.603152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.603337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.619912] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d in Status: IN_PROGRESS for 2s [ 1063.900949] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.065058] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.066427] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4782c2a6-1bbe-439a-8ca0-a877a025980f with status ACTIVE [ 1064.066692] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.066834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.067037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.067115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.067737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.068446] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.068624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.068624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.068799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.068865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.069059] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.069178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.069298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.069472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.069472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.069472] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4782c2a6-1bbe-439a-8ca0-a877a025980f is going to be updated. [ 1064.072827] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.072827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.096457] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.096457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.096457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.096670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.096670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.096823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4782c2a6-1bbe-439a-8ca0-a877a025980f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.403577] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.403856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.403856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.404722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.404722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.404722] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be updated. [ 1064.408826] env[66157]: INFO networking_nsxv3.common.synchronization [req-17597ac3-1ae2-419a-9dff-41269592c354 req-f7194801-4bf1-4e0e-b5e1-b6b4a0101849 tempest-ServerDiskConfigTestJSON-633808516 tempest-ServerDiskConfigTestJSON-633808516-project-member] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 1064.409528] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGHEST for action security_group_members [ 1064.409839] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.410253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.410253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.410253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.410378] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.410468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.410525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.410671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.410756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.410846] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.440639] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.440759] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.440825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.441051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.441196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.446243] env[66157]: INFO networking_nsxv3.common.synchronization [req-cc2a249c-74c6-4d22-a872-faff8a493be1 req-2e6a545f-5c56-4336-b6ce-9ef477d995c6 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_members [ 1064.446754] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGHEST for action security_group_members [ 1064.447074] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ed4675f-1916-4e79-b525-fb7797e97825 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.447195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.447261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.447453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.447720] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.447720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.447846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.447884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.447961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.448069] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.451963] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1064.565842] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.700973] env[66157]: INFO networking_nsxv3.common.synchronization [req-dbbcd0a8-1e5e-4587-9485-f275a3558468 req-16e5a2bb-898b-4917-a1f1-6ed66277bdeb tempest-ServerActionsTestOtherB-552517833 tempest-ServerActionsTestOtherB-552517833-project-member] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1064.701589] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1064.701899] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.703082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.703176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.703580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.703889] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.703978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.704113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.704243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.704338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.704583] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.912697] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.912873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.912973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.913212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.913311] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.913628] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.913825] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.914022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.914182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.914298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.914459] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be updated. [ 1064.949218] env[66157]: INFO networking_nsxv3.common.synchronization [req-4aab2942-c491-4248-b18a-a76961f52d0b req-3ac74e37-57e6-4e9f-b40e-78346a1d3038 tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1064.949951] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.950160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.950228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.950452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.950597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.951928] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1064.952265] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.952381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.952448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.952611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.952693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.953011] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.953114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.953177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.953319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.953394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.953477] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ed4675f-1916-4e79-b525-fb7797e97825 is going to be updated. [ 1064.954513] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.954637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.954705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.954889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.955077] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.955220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.955380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.955549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.955709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.955927] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.966317] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: IN_PROGRESS for 2s [ 1064.990133] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.990337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.990337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.990550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.990732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.000559] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ed4675f-1916-4e79-b525-fb7797e97825 in Status: IN_PROGRESS for 2s [ 1065.068588] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.068945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.070037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.074027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.074027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.074027] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 is going to be created. [ 1065.106483] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.106663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.106729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.108025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.108025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.125493] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 in Status: UNINITIALIZED for 2s [ 1065.178332] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.178538] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.178658] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.179061] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.181204] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.181408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.181532] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.181774] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.181924] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.182189] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.182337] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.182455] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.182588] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.182700] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.182807] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.182965] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.202950] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.203145] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.203285] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.203466] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.203844] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-a26c0755-f52b-4575-88d3-7e91b076dfca taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.204118] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-a26c0755-f52b-4575-88d3-7e91b076dfca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.204172] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-a26c0755-f52b-4575-88d3-7e91b076dfca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.204468] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-a26c0755-f52b-4575-88d3-7e91b076dfca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.204600] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a26c0755-f52b-4575-88d3-7e91b076dfca',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.208209] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.208337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.208405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.208829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.208829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.208939] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.208939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.209040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.209144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.209218] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.209301] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a already deleted. [ 1065.209376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.459802] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.633245] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d in Status: SUCCESS [ 1065.633245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.708194] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.708194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.708194] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.708469] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.708528] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.708689] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port a26c0755-f52b-4575-88d3-7e91b076dfca not found, creating... [ 1065.708967] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.709234] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.709373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.709599] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.709736] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.710704] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.710704] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.710704] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.710704] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.711336] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.711336] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: a26c0755-f52b-4575-88d3-7e91b076dfca is going to be created. [ 1065.736550] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.736862] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.737019] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.737235] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.737470] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.737701] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-a26c0755-f52b-4575-88d3-7e91b076dfca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.962409] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.468247] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.468247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.468247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.468247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.468247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.468247] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1066.472860] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1066.472860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.472860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.472860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.472860] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.472860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.472860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.472860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.472860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.472860] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.472860] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.484575] env[66157]: INFO networking_nsxv3.common.synchronization [req-dbbcd0a8-1e5e-4587-9485-f275a3558468 req-a5a9aa8f-cdcf-4515-b70e-35c7ca82d5a4 service nova] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1066.484751] env[66157]: INFO networking_nsxv3.common.synchronization [req-dbbcd0a8-1e5e-4587-9485-f275a3558468 req-a5a9aa8f-cdcf-4515-b70e-35c7ca82d5a4 service nova] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1066.486471] env[66157]: INFO networking_nsxv3.common.synchronization [req-dbbcd0a8-1e5e-4587-9485-f275a3558468 req-a5a9aa8f-cdcf-4515-b70e-35c7ca82d5a4 service nova] Enqueued Resource ID: a26c0755-f52b-4575-88d3-7e91b076dfca with Priority: HIGHEST for action port [ 1066.486471] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1066.486471] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1066.486471] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a26c0755-f52b-4575-88d3-7e91b076dfca with Priority: HIGHEST for action port [ 1066.486471] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.486952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.486952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.487429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.487536] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.488465] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.488589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.488674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.489104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.489104] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.489104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.489309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.490469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.490469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.490469] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.490469] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a26c0755-f52b-4575-88d3-7e91b076dfca taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.490469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a26c0755-f52b-4575-88d3-7e91b076dfca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.490827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a26c0755-f52b-4575-88d3-7e91b076dfca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.491298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a26c0755-f52b-4575-88d3-7e91b076dfca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.491298] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a26c0755-f52b-4575-88d3-7e91b076dfca',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.493059] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.493216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.493296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.493475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.493664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.503979] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1066.976407] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.976877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.977086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.977395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.977686] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.978286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.978746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.980026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.980026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.980026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.980026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.980026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.980026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.980026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.980026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.980026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.980026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.980868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.981073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.981259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.981466] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.984613] env[66157]: INFO networking_nsxv3.common.synchronization [req-92c28a98-0b38-4ca1-98e0-21a1d193c118 req-ae1b7003-f2d1-4629-891a-b72cde7f6733 tempest-MultipleCreateTestJSON-2091741498 tempest-MultipleCreateTestJSON-2091741498-project-member] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1066.986301] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 in Status: SUCCESS [ 1066.987866] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 deletion is rescheduled due to dependency. [ 1066.987866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.988404] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1066.989107] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.991604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.991604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.991604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.991604] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.991604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.991604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.991604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.991604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.991604] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.999022] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.999022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.999022] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a26c0755-f52b-4575-88d3-7e91b076dfca with status ACTIVE [ 1066.999022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.999022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.999022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.999642] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.999642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.999642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.999642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.999642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.999642] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a26c0755-f52b-4575-88d3-7e91b076dfca is going to be updated. [ 1067.016074] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ed4675f-1916-4e79-b525-fb7797e97825 in Status: SUCCESS [ 1067.016074] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ed4675f-1916-4e79-b525-fb7797e97825 deletion is rescheduled due to dependency. [ 1067.016074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.032412] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.034132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.034132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.034132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.034132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.034132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a26c0755-f52b-4575-88d3-7e91b076dfca" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.138221] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 in Status: SUCCESS [ 1067.138527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.138731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.139011] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.139287] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.139426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.139772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.139772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.139772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.139949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.139949] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.341560] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.343032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.343032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.343032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.343032] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.343476] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.343733] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.344225] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.344523] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.344888] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.345153] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.345389] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.345652] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.348310] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.348310] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.348310] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.372735] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.372735] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.372735] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.372735] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.372735] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-1e574eeb-7308-46e9-8532-30545c0de757 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.373111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-1e574eeb-7308-46e9-8532-30545c0de757" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.373111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-1e574eeb-7308-46e9-8532-30545c0de757" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.373338] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-1e574eeb-7308-46e9-8532-30545c0de757" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.373716] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e574eeb-7308-46e9-8532-30545c0de757',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.491343] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a3d86b0-5e47-4031-aa77-b1a917545a8b: rpc.has_security_group_logging(os_id): False [ 1067.495486] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.495571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.495733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.495946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.496085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.496786] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.496786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.496786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.496786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.496786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.496786] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be already deleted. [ 1067.496786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.497153] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.512924] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.513098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.513180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.513378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.513547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.513714] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.513813] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.513868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.514193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.514193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.514359] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.514359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.514507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.514582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.514637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.515259] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.515259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.515259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.515259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.515259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.515520] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be updated. [ 1067.588704] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.588898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.588946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.589147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.589298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.605486] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1067.643184] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.876796] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.877204] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.877204] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.877512] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.877665] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.877879] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 1e574eeb-7308-46e9-8532-30545c0de757 not found, creating... [ 1067.878131] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.878293] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.878406] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.878686] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.878763] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.879136] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.879394] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.879526] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.879743] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.879870] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.880018] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 1e574eeb-7308-46e9-8532-30545c0de757 is going to be created. [ 1067.905605] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.906540] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.906540] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.906540] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.906540] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.906891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-1e574eeb-7308-46e9-8532-30545c0de757" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.002313] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.002313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.002313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.002313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.002606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.002606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be created. [ 1068.036741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.037321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.037321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.037321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.037321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.048309] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: UNINITIALIZED for 2s [ 1068.145044] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719: rpc.has_security_group_logging(os_id): False [ 1068.163513] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.163706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.163760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.163945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.164336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.164336] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.164488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.164488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.164736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.164736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.164736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 is going to be created. [ 1068.227556] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.227739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.227739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.227912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.228123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.238607] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 in Status: IN_PROGRESS for 2s [ 1068.514629] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1068.514980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.621144] env[66157]: INFO networking_nsxv3.common.synchronization [req-92c28a98-0b38-4ca1-98e0-21a1d193c118 req-7b8a4b7e-541c-4bd2-8920-0d56cc5c07b3 service nova] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_rules [ 1068.621330] env[66157]: INFO networking_nsxv3.common.synchronization [req-92c28a98-0b38-4ca1-98e0-21a1d193c118 req-7b8a4b7e-541c-4bd2-8920-0d56cc5c07b3 service nova] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1068.621481] env[66157]: INFO networking_nsxv3.common.synchronization [req-92c28a98-0b38-4ca1-98e0-21a1d193c118 req-7b8a4b7e-541c-4bd2-8920-0d56cc5c07b3 service nova] Enqueued Resource ID: 1e574eeb-7308-46e9-8532-30545c0de757 with Priority: HIGHEST for action port [ 1068.623970] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_rules [ 1068.624191] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1068.624348] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e574eeb-7308-46e9-8532-30545c0de757 with Priority: HIGHEST for action port [ 1068.624987] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.625186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.625340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.625677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.625854] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.627027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.627314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.627435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.627977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.627977] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.628156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.628156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.628517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.628688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.630629] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.633962] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e574eeb-7308-46e9-8532-30545c0de757 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.633962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e574eeb-7308-46e9-8532-30545c0de757" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.633962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e574eeb-7308-46e9-8532-30545c0de757" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.633962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e574eeb-7308-46e9-8532-30545c0de757" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.633962] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e574eeb-7308-46e9-8532-30545c0de757',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.136220] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.137413] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.137550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.141024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e574eeb-7308-46e9-8532-30545c0de757 with status ACTIVE [ 1069.141024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.141024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.141024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.141024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.141024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e574eeb-7308-46e9-8532-30545c0de757 is going to be updated. [ 1069.167771] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.167771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.167771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.168065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.168065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.168325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e574eeb-7308-46e9-8532-30545c0de757" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.492713] env[66157]: INFO networking_nsxv3.common.synchronization [req-92c28a98-0b38-4ca1-98e0-21a1d193c118 req-4834d808-c71a-4701-9e3e-99b14421c032 tempest-MultipleCreateTestJSON-2091741498 tempest-MultipleCreateTestJSON-2091741498-project-member] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1069.493306] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1069.493636] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.493760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.621180] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1069.621449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.641176] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.890431] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.890666] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.890798] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.891066] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.891327] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.891482] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.891597] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.891810] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.891953] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.892192] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.892333] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.892449] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.892557] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.892714] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.892772] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.892896] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.912131] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.912295] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1069.912435] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.912614] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.912987] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-0168ce76-8a57-44cc-b509-7125079af6d1 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.913115] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-0168ce76-8a57-44cc-b509-7125079af6d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.913214] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-0168ce76-8a57-44cc-b509-7125079af6d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.913614] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-0168ce76-8a57-44cc-b509-7125079af6d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.913729] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0168ce76-8a57-44cc-b509-7125079af6d1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.068967] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1070.069424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.069654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.069943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.070200] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.070374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.070480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.070716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.070846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.070962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.071118] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.148044] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.148044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.148044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.148044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.148044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.148044] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be created. [ 1070.183028] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.183028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.193095] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: UNINITIALIZED for 2s [ 1070.253960] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 in Status: SUCCESS [ 1070.253960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.416501] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.418275] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.418472] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.418774] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.418938] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.419123] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 0168ce76-8a57-44cc-b509-7125079af6d1 not found, creating... [ 1070.419428] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.419594] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.419722] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.420045] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.420212] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.420507] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.420663] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.420778] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.420983] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.422819] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.423039] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 0168ce76-8a57-44cc-b509-7125079af6d1 is going to be created. [ 1070.453634] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.453634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.453634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.453634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.454047] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.457539] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-0168ce76-8a57-44cc-b509-7125079af6d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.573636] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.077553] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 612116dc-6e5d-4737-93ca-c21312262c3a: rpc.has_security_group_logging(os_id): False [ 1071.099838] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.100052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.100052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.100284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.100372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.100756] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.100756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.100910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.100991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.101091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.101532] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be created. [ 1071.175281] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.175446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.175515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.176143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.176143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.193220] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1071.248880] env[66157]: INFO networking_nsxv3.common.synchronization [req-92c28a98-0b38-4ca1-98e0-21a1d193c118 req-ad279200-3d62-40ae-9ca7-f2c404ae9313 service nova] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_rules [ 1071.248880] env[66157]: INFO networking_nsxv3.common.synchronization [req-92c28a98-0b38-4ca1-98e0-21a1d193c118 req-ad279200-3d62-40ae-9ca7-f2c404ae9313 service nova] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1071.248880] env[66157]: INFO networking_nsxv3.common.synchronization [req-92c28a98-0b38-4ca1-98e0-21a1d193c118 req-ad279200-3d62-40ae-9ca7-f2c404ae9313 service nova] Enqueued Resource ID: 0168ce76-8a57-44cc-b509-7125079af6d1 with Priority: HIGHEST for action port [ 1071.249351] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_rules [ 1071.249644] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1071.249644] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0168ce76-8a57-44cc-b509-7125079af6d1 with Priority: HIGHEST for action port [ 1071.249903] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.250024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.250240] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.250310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.250489] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0168ce76-8a57-44cc-b509-7125079af6d1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.250579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0168ce76-8a57-44cc-b509-7125079af6d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.250702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0168ce76-8a57-44cc-b509-7125079af6d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.250935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0168ce76-8a57-44cc-b509-7125079af6d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.251055] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0168ce76-8a57-44cc-b509-7125079af6d1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.755143] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0168ce76-8a57-44cc-b509-7125079af6d1 with status ACTIVE [ 1071.755641] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.755840] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.755935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.756527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.756527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.756763] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.756763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.756763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.756939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.757017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.757233] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.757363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.757448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.757658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.757782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.757912] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0168ce76-8a57-44cc-b509-7125079af6d1 is going to be updated. [ 1071.781902] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.782076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.782076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.782283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.782423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.782581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0168ce76-8a57-44cc-b509-7125079af6d1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.995279] env[66157]: INFO networking_nsxv3.common.synchronization [req-51d63612-bf81-430a-86f0-f70dce1692ed req-6364e616-21e5-41fe-9c50-198b07eed301 tempest-ImagesOneServerNegativeTestJSON-417779338 tempest-ImagesOneServerNegativeTestJSON-417779338-project-member] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 1071.995890] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 1071.996220] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.996344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.996409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.996880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.997082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.997171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.997232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.997392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.997479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.997576] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.204941] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1072.206621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.206830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.207091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.209222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.209222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.209222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.210251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.210359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.210457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.210541] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.211459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.211683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.212871] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.214028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.214028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.214216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.214345] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.214524] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.392028] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.392216] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.392340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.392882] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.393009] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.393276] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.393408] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.393659] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.393803] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.394031] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.394147] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.394392] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.394517] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.394632] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.394737] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.395232] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.414232] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.414400] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1072.414538] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.414710] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-712" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.415039] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-f072b972-9e69-4b18-8664-1fb3dbd68d93 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.415211] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-f072b972-9e69-4b18-8664-1fb3dbd68d93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.415326] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-f072b972-9e69-4b18-8664-1fb3dbd68d93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.415763] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-f072b972-9e69-4b18-8664-1fb3dbd68d93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.415897] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f072b972-9e69-4b18-8664-1fb3dbd68d93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.500284] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.500437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.500509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.500726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.500905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.501211] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.501317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.501382] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.501558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.501638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.501725] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 1072.530880] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.531209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.531256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.531446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.531592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.545810] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 1072.716979] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.717202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.717422] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.920035] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.920180] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.920308] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.920626] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.920793] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.920973] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port f072b972-9e69-4b18-8664-1fb3dbd68d93 not found, creating... [ 1072.923150] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.923334] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.923456] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.923690] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.923861] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.924138] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.924306] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.924423] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.924636] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.924800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.924909] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: f072b972-9e69-4b18-8664-1fb3dbd68d93 is going to be created. [ 1072.949586] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.949824] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.949989] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.950228] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.950466] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.950698] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-f072b972-9e69-4b18-8664-1fb3dbd68d93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.207298] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1073.207595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.220365] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.568429] env[66157]: INFO networking_nsxv3.common.synchronization [req-359b8c06-9159-4210-a485-961398fb2b19 req-28cd5cf2-47f5-4022-9cf7-6cdec703cda0 tempest-ServersNegativeTestJSON-423798559 tempest-ServersNegativeTestJSON-423798559-project-member] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1073.569279] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1073.569398] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.569515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.569584] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.569789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.569943] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.570231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.570271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.570431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.570524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.570613] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.650546] env[66157]: INFO networking_nsxv3.common.synchronization [req-51d63612-bf81-430a-86f0-f70dce1692ed req-f7f87000-e49c-4222-985f-f6f457df5942 service nova] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_rules [ 1073.650988] env[66157]: INFO networking_nsxv3.common.synchronization [req-51d63612-bf81-430a-86f0-f70dce1692ed req-f7f87000-e49c-4222-985f-f6f457df5942 service nova] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 1073.650988] env[66157]: INFO networking_nsxv3.common.synchronization [req-51d63612-bf81-430a-86f0-f70dce1692ed req-f7f87000-e49c-4222-985f-f6f457df5942 service nova] Enqueued Resource ID: f072b972-9e69-4b18-8664-1fb3dbd68d93 with Priority: HIGHEST for action port [ 1073.651487] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_rules [ 1073.651577] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 1073.651680] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f072b972-9e69-4b18-8664-1fb3dbd68d93 with Priority: HIGHEST for action port [ 1073.651960] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.652389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.652485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.652977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.653417] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.654255] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.654719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.655039] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-f072b972-9e69-4b18-8664-1fb3dbd68d93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.655760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f072b972-9e69-4b18-8664-1fb3dbd68d93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.655760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f072b972-9e69-4b18-8664-1fb3dbd68d93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.655760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f072b972-9e69-4b18-8664-1fb3dbd68d93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.655760] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f072b972-9e69-4b18-8664-1fb3dbd68d93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.722576] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.722735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.722797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.722992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.723099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.723207] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1073.761395] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.761843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.761843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.761843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.762676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.774815] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1074.072428] env[66157]: INFO networking_nsxv3.common.synchronization [req-2e00f650-8720-4664-b05c-afd38fda3fd9 req-60a03b09-4abb-4f0e-b2a0-32ded8dad010 tempest-ServersTestFqdnHostnames-1310601545 tempest-ServersTestFqdnHostnames-1310601545-project-member] Enqueued Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_members [ 1074.072560] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.075265] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_members [ 1074.076487] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4120ed87-fb96-4685-aabd-90a91df342cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.076487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.076487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.076487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.076487] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.076763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.076763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.076763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.076863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.076968] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.157080] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.157214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.157406] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f072b972-9e69-4b18-8664-1fb3dbd68d93 with status ACTIVE [ 1074.157562] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.157664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.157736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.157962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.158060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.158226] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.158318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.158378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.158526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.158602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.158779] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.158868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.158928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.159073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.159140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.159218] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f072b972-9e69-4b18-8664-1fb3dbd68d93 is going to be updated. [ 1074.180521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.180950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.180950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.180950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.181136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.181213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f072b972-9e69-4b18-8664-1fb3dbd68d93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.426722] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-462 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.427020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-462" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.427099] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-462" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.427384] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-462" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.427683] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.427911] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.428050] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.428280] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.428422] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.428630] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.428740] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.428847] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.428954] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.429073] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.429179] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.429306] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.448907] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.449077] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.450138] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.450138] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-462" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.450138] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-3097c11f-e21b-4e26-b344-030ae6e4c564 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.450138] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-3097c11f-e21b-4e26-b344-030ae6e4c564" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.450138] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-3097c11f-e21b-4e26-b344-030ae6e4c564" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.450444] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-3097c11f-e21b-4e26-b344-030ae6e4c564" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.450444] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3097c11f-e21b-4e26-b344-030ae6e4c564',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.555630] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 1074.555823] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 deletion is rescheduled due to dependency. [ 1074.555940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.556125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.556338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.556578] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.556705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.556768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.556919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.556998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.557104] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.576132] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.578790] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.578926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.579020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.579207] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.579292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.579478] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.579571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.579666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.579771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.579844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.579926] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4120ed87-fb96-4685-aabd-90a91df342cd already deleted. [ 1074.580014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.952989] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.953219] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.953399] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.953722] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.953902] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.954097] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 3097c11f-e21b-4e26-b344-030ae6e4c564 not found, creating... [ 1074.954406] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.954596] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.954742] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.955042] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.955238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.955642] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.955901] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.956059] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.956405] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.956586] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.956748] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 3097c11f-e21b-4e26-b344-030ae6e4c564 is going to be created. [ 1074.978051] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.978239] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.978239] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.978577] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.978846] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.979129] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-3097c11f-e21b-4e26-b344-030ae6e4c564" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.060736] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.079788] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.079788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.079788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.079788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.079788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.079788] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be updated. [ 1075.140350] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.140575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.140625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.140912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.141175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.157054] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1075.563163] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.722515] env[66157]: INFO networking_nsxv3.common.synchronization [req-2e00f650-8720-4664-b05c-afd38fda3fd9 req-ade52605-928b-4dcc-9f8d-30c29a9e02e4 service nova] Enqueued Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_rules [ 1075.722787] env[66157]: INFO networking_nsxv3.common.synchronization [req-2e00f650-8720-4664-b05c-afd38fda3fd9 req-ade52605-928b-4dcc-9f8d-30c29a9e02e4 service nova] Enqueued Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_members [ 1075.723032] env[66157]: INFO networking_nsxv3.common.synchronization [req-2e00f650-8720-4664-b05c-afd38fda3fd9 req-ade52605-928b-4dcc-9f8d-30c29a9e02e4 service nova] Enqueued Resource ID: 3097c11f-e21b-4e26-b344-030ae6e4c564 with Priority: HIGHEST for action port [ 1075.723681] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_rules [ 1075.723871] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_members [ 1075.725574] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3097c11f-e21b-4e26-b344-030ae6e4c564 with Priority: HIGHEST for action port [ 1075.725989] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4120ed87-fb96-4685-aabd-90a91df342cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.726085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.726163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.726404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.726484] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.728565] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4120ed87-fb96-4685-aabd-90a91df342cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.728696] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.728829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.729131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.729328] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.729447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.729529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.729695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.729810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.729938] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.732497] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3097c11f-e21b-4e26-b344-030ae6e4c564 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.732695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3097c11f-e21b-4e26-b344-030ae6e4c564" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.732903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3097c11f-e21b-4e26-b344-030ae6e4c564" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.733255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3097c11f-e21b-4e26-b344-030ae6e4c564" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.733255] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3097c11f-e21b-4e26-b344-030ae6e4c564',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.788767] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1075.789222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.789222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.789403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.789496] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.789618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.789693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.789836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.789928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.790045] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.067202] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.067202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.067396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.067487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.067535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.067638] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 1076.105190] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.105190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.105190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.105559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.105820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.120236] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 1076.242022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4120ed87-fb96-4685-aabd-90a91df342cd taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.242022] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.242022] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3097c11f-e21b-4e26-b344-030ae6e4c564 with status ACTIVE [ 1076.242022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.242022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.242022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.242684] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.242684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.242684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.243681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.243681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.243681] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3097c11f-e21b-4e26-b344-030ae6e4c564 is going to be updated. [ 1076.265837] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.266059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.266059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.266301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.266444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.266649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3097c11f-e21b-4e26-b344-030ae6e4c564" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.292617] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.742017] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.795982] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.171044] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1077.172873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.245370] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.245530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.245608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.245809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.245898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.245995] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4120ed87-fb96-4685-aabd-90a91df342cd is going to be created. [ 1077.282146] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.282312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.282389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.282667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.283473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.295423] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4120ed87-fb96-4685-aabd-90a91df342cd in Status: UNINITIALIZED for 2s [ 1077.298976] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.299143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.299211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.299425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.299509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.299605] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1077.346580] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.346580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.346580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.346974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.346974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.358992] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1078.131236] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 1078.131574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.131647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.131872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.132110] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.132228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.132294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.132487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.132573] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.132660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.132754] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.636089] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.636523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.636523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.636640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.636770] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.636835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.636891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.637093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.637205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.637398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.637602] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.637734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.638064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.638231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.638528] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.638783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.638866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.639206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.639312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.639450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.639566] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.143159] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83a8fa88-5bec-4b31-8608-ce09049bd610: rpc.has_security_group_logging(os_id): False [ 1079.159904] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.160083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.160083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.160269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.160356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.160577] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.160767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.160833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.160986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.161073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.161256] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.161359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.161421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.161529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.161600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.161792] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.162358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.162358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.162358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.162358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.162358] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 1079.227359] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.227526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.227582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.227792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.227962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.240205] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 1079.307447] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4120ed87-fb96-4685-aabd-90a91df342cd in Status: SUCCESS [ 1079.307761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.308033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.308317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.308545] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.308717] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.308843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.309140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.309248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.309371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.309503] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.370882] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1079.371165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.371349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.371611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.371809] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.372010] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.372010] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.372153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.372233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.372323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.372518] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.372615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.372670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.372815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.372954] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.373059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.373120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.373257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.373507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.373619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.373738] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.813578] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.878077] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16ef380f-fc6a-4b09-a172-185ed835a4be: rpc.has_security_group_logging(os_id): False [ 1079.978303] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.978483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.978563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.978764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.978854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.979209] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.979319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.979431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.979581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.979658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.979901] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.980024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.980024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.980184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.980290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.980504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.980608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.980690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.980834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.980885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.980973] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be created. [ 1080.051349] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.051525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.051570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.051777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.051969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.067194] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1080.316442] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4120ed87-fb96-4685-aabd-90a91df342cd: rpc.has_security_group_logging(os_id): False [ 1080.337332] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.337479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.337555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.337776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.337888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.338175] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.338279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.338367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.338549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.338625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.338726] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4120ed87-fb96-4685-aabd-90a91df342cd is going to be created. [ 1080.404724] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.404951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.404951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.405192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.405409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.418132] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4120ed87-fb96-4685-aabd-90a91df342cd in Status: IN_PROGRESS for 2s [ 1080.513017] env[66157]: INFO networking_nsxv3.common.synchronization [req-8667dc99-e715-42b6-8a6b-8a4be6cc4815 req-60deaa0a-ae19-4275-a7f0-530f38546dfb tempest-AttachVolumeTestJSON-1599628970 tempest-AttachVolumeTestJSON-1599628970-project-member] Enqueued Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_members [ 1080.513678] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_members [ 1080.514075] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.514181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.514255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.514518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.514682] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.514773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.514835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.514994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.515090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.515208] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.860071] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.860071] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.860800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.860800] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.860800] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.861143] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.861143] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.861332] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.861456] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.861674] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.861777] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.861884] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.861990] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.862111] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.862215] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.862344] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.883305] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.883551] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1080.883630] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.883746] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.884078] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-48b66cfb-9d27-4487-8e3d-f525205e23f5 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.884252] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-48b66cfb-9d27-4487-8e3d-f525205e23f5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.884373] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-48b66cfb-9d27-4487-8e3d-f525205e23f5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.884693] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-48b66cfb-9d27-4487-8e3d-f525205e23f5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.884827] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48b66cfb-9d27-4487-8e3d-f525205e23f5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.020619] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.020827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.020878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.021113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.021209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.021416] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.021516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.021576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.021709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.021780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.021861] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a already deleted. [ 1081.021938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.259962] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 1081.259962] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.387701] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.388020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.388136] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.388445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.388603] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.388760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 48b66cfb-9d27-4487-8e3d-f525205e23f5 not found, creating... [ 1081.389057] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.389228] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.389359] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.389584] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.389737] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.390053] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.390215] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.390343] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.390565] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.390702] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.390853] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 48b66cfb-9d27-4487-8e3d-f525205e23f5 is going to be created. [ 1081.412481] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.412744] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.412887] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.413404] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.413661] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.413916] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-48b66cfb-9d27-4487-8e3d-f525205e23f5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.083043] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1082.083281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.083329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.083549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.083643] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.145262] env[66157]: INFO networking_nsxv3.common.synchronization [req-8667dc99-e715-42b6-8a6b-8a4be6cc4815 req-7a999960-5665-4758-adf8-fc9d6bf3ae19 service nova] Enqueued Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_rules [ 1082.145464] env[66157]: INFO networking_nsxv3.common.synchronization [req-8667dc99-e715-42b6-8a6b-8a4be6cc4815 req-7a999960-5665-4758-adf8-fc9d6bf3ae19 service nova] Enqueued Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_members [ 1082.145609] env[66157]: INFO networking_nsxv3.common.synchronization [req-8667dc99-e715-42b6-8a6b-8a4be6cc4815 req-7a999960-5665-4758-adf8-fc9d6bf3ae19 service nova] Enqueued Resource ID: 48b66cfb-9d27-4487-8e3d-f525205e23f5 with Priority: HIGHEST for action port [ 1082.146122] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_rules [ 1082.146256] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_members [ 1082.146353] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b66cfb-9d27-4487-8e3d-f525205e23f5 with Priority: HIGHEST for action port [ 1082.146620] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.146738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.146805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.147215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.147316] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.148131] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.149054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.149054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.149054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.149054] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.149607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.149864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.149864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.149990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.150140] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.151086] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-48b66cfb-9d27-4487-8e3d-f525205e23f5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.151245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48b66cfb-9d27-4487-8e3d-f525205e23f5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.151373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48b66cfb-9d27-4487-8e3d-f525205e23f5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.151556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48b66cfb-9d27-4487-8e3d-f525205e23f5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.151699] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48b66cfb-9d27-4487-8e3d-f525205e23f5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.429944] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4120ed87-fb96-4685-aabd-90a91df342cd in Status: SUCCESS [ 1082.430452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.496657] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.496831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.496873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.497134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.497243] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.586805] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.587069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.587192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.587508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.587794] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.588046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.588124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.588383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.588636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.588748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.588863] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.654283] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.654453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.654738] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.655897] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48b66cfb-9d27-4487-8e3d-f525205e23f5 with status ACTIVE [ 1082.656243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.656349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.656428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.656888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.656888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.657934] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.658123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.658224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.658689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.658842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.659130] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.659365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.659458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.659652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.659757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.659889] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48b66cfb-9d27-4487-8e3d-f525205e23f5 is going to be updated. [ 1082.682731] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.683241] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.683241] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.683450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.683532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.683740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48b66cfb-9d27-4487-8e3d-f525205e23f5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.000616] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.094063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.094063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.094063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.094063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.094063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.094920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.094920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.094920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.094920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.094920] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.162441] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.504085] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.596654] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16ef380f-fc6a-4b09-a172-185ed835a4be: rpc.has_security_group_logging(os_id): False [ 1083.615032] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.615032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.615395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.615395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.615520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.615779] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.615779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.615953] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.616039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.616088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.616355] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.616463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.616463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.616595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.616654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.616846] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.616942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.617019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.617131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.617202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.617285] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1083.665042] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.665042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.665261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.665404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.665480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.665582] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a is going to be created. [ 1083.683972] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.684164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.684206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.685171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.685171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.693179] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.693569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.693569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.693569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.693720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.697567] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1083.703038] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a in Status: UNINITIALIZED for 2s [ 1084.006979] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1084.006979] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1084.948449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.949921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.949921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.949921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.975141] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1084.975141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.976645] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1084.989363] env[66157]: INFO networking_nsxv3.common.synchronization [req-637c6f8c-06a8-4c47-a44f-c51a416842e9 req-19810616-a74d-460c-9c09-10cb98b3bb7b tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_members [ 1084.993174] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_members [ 1084.993736] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe07656-65ae-471b-953b-0e7810aed7b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.993873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.993943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.994388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.994467] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.994529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.994567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.994762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.994851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.994946] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.018849] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.019049] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.019096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.019274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.034337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.035266] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1085.035421] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1085.035942] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1085.089513] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.089513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.089513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.089921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.092437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.092731] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1085.207130] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.207130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.207280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.207395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.207973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.208559] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1085.329535] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.329788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.329788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.329960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.330517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.330823] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1085.330915] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a68cfe0b-467e-482c-b4ec-3f99b4e37ecf', '2a3d86b0-5e47-4031-aa77-b1a917545a8b', '2bade862-ff24-47f6-913c-4a011dd3df71', '00106a4a-ef70-4397-a8b9-afffa44e977b', 'f7e2acfe-17af-4683-bd94-9fc47ded2886', '16ef380f-fc6a-4b09-a172-185ed835a4be', '83c10e8c-149e-450b-b827-98a5e9d401e0', '98809cbd-e3ae-4c26-8c2a-269a263d4ce9', 'b6a87886-c2f5-4505-92ee-9c2a202b7b93', 'd4020162-d3ee-46af-a408-8b847c1e7ac2', '2381db7b-1b29-4dfc-a6af-48c498e3e0b0', '82429466-a5a1-4b39-8d12-17fe5aa80977', '83a8fa88-5bec-4b31-8608-ce09049bd610', 'd5ccf21c-eeb9-4add-8ed5-296070039162', '4339fe92-f605-41dc-aba6-ccecae77b024', '54f8f8d4-52f2-44d4-ac27-8664220f43ee', '65e20f28-433e-4752-bdc0-b5f939f691d0', 'da99f927-2e97-469c-9968-08c9ce21543a', '646e01e7-0331-4a5c-9b1a-a3be54c1ee07', '5c9d6f11-6204-4093-b454-2cfd24b63dae', '612116dc-6e5d-4737-93ca-c21312262c3a', 'b5b02819-f659-4343-b709-2e63116c5829', '68270d8f-ab80-474f-8966-489611b2e965', '9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94', '413d37d4-0b94-44d0-aa20-20a2f41994ba', '4120ed87-fb96-4685-aabd-90a91df342cd', '62b70f12-d63b-40fb-b48e-a611590fad1f', 'fc8d54c1-30b0-4581-9d61-8b194199903c', '222383c0-b19b-4725-af40-286f27465c68', 'cd4d34e1-d4d8-4980-86c7-3c5c3b76571b', '58626db2-1bef-478d-8fe6-5cb88f964fa3', 'c4915dbf-d6e2-46dd-8508-11f50b8da0ef', '099cf4d4-ded3-44df-b6e7-328bc3763be6', '7a251e98-2d26-4017-96a0-c67e8ea7efc0', 'd99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d', '047471a8-6f49-4481-a53f-c45f9c23e798', '6b93b3d3-7a24-441f-88d0-38d5293ec145', '4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1', '8a39b75b-de15-457f-a080-b14841d7ea90', '7b48ccef-7f9a-4d48-8b46-294031485bbd', 'd46b1e4e-446b-4001-9e14-1ab5b40a8087', '21980f25-eb0b-4647-8b51-f835b6f941ea', '8cb67253-fbd5-4c41-8d67-3b3c6d1bc719', '1ed4675f-1916-4e79-b525-fb7797e97825', '4bb5a370-76e0-4d7c-9a46-84239200c704', 'd5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24', 'fec754f5-f737-48ef-9255-9d4bc7df0c2e', 'a38d5e1a-6785-4c65-98b8-9c43e55d070c'} {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1085.331116] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1085.353664] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.353952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.353952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.354271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.354271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.354431] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1085.354431] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1085.354620] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1085.380413] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.381053] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.381053] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.381053] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.381259] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.381423] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.381537] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.381753] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.381919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.382134] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.382325] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.382442] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.382560] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.382698] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.382856] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.382993] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.426593] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.426809] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.428610] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.428610] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.428610] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.429495] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.429495] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.429495] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.429722] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1276a3be-8538-4d49-a8f9-38bfa4ccd5dc',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.439438] env[66157]: INFO networking_nsxv3.common.synchronization [req-af765607-4ff7-410a-b885-9a150e6457bf req-f6dc75c9-76bc-43a6-a82f-6ae6e43eac98 tempest-ImagesOneServerNegativeTestJSON-417779338 tempest-ImagesOneServerNegativeTestJSON-417779338-project-member] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 1085.440194] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGHEST for action security_group_members [ 1085.440581] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.440698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.440759] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.441019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.441234] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.441386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.441456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.441634] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.441721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.441838] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.491889] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.492098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.492234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.492498] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.493590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.493974] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1085.493974] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1085.494089] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1085.494129] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1085.494201] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1085.494269] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGH for action security_group_rules [ 1085.494350] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGH for action security_group_rules [ 1085.494516] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGH for action security_group_rules [ 1085.494606] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGH for action security_group_rules [ 1085.494674] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGH for action security_group_rules [ 1085.494744] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGH for action security_group_rules [ 1085.494853] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGH for action security_group_rules [ 1085.494905] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGH for action security_group_rules [ 1085.494975] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGH for action security_group_rules [ 1085.495042] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGH for action security_group_rules [ 1085.495107] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGH for action security_group_rules [ 1085.495221] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGH for action security_group_rules [ 1085.495313] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGH for action security_group_rules [ 1085.495401] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGH for action security_group_rules [ 1085.495514] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGH for action security_group_rules [ 1085.495566] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGH for action security_group_rules [ 1085.495615] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGH for action security_group_rules [ 1085.495651] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGH for action security_group_rules [ 1085.495722] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGH for action security_group_rules [ 1085.495766] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGH for action security_group_rules [ 1085.495852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.498648] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.498787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.499251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.499251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.499251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.499529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.499529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.499529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.499654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.499654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.499729] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe07656-65ae-471b-953b-0e7810aed7b9 already deleted. [ 1085.499972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.715585] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a in Status: SUCCESS [ 1085.715907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.716122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.716715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.716715] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.716715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.716715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.716715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.717290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.717290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.717290] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.721468] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1085.724989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.934049] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.934049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.934049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.934484] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.934484] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.934484] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 1276a3be-8538-4d49-a8f9-38bfa4ccd5dc not found, creating... [ 1085.935405] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.935405] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.935405] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.935405] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.935772] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.935772] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.939024] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.939024] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.939024] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.939024] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.939024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 1276a3be-8538-4d49-a8f9-38bfa4ccd5dc is going to be created. [ 1085.945687] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.945907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.945907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.946176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.964786] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.964786] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.964786] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.964786] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.966524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.966524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.972248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.972782] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.973009] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.973182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.973496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.973645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.973737] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be updated. [ 1086.010828] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.011070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.011070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.011294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.011440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.021535] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: IN_PROGRESS for 2s [ 1086.203251] env[66157]: INFO networking_nsxv3.common.synchronization [req-a159c58b-f621-4091-a35b-d4978c6c7dac req-8cb2f7ec-ab5a-490e-b389-7d0f63111ee6 tempest-MultipleCreateTestJSON-2091741498 tempest-MultipleCreateTestJSON-2091741498-project-member] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1086.203761] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1086.203904] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf with Priority: HIGH for action security_group_rules [ 1086.204015] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bade862-ff24-47f6-913c-4a011dd3df71 with Priority: HIGH for action security_group_rules [ 1086.204122] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 with Priority: HIGH for action security_group_rules [ 1086.204215] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4339fe92-f605-41dc-aba6-ccecae77b024 with Priority: HIGH for action security_group_rules [ 1086.204308] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae with Priority: HIGH for action security_group_rules [ 1086.204401] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 with Priority: HIGH for action security_group_rules [ 1086.204528] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da99f927-2e97-469c-9968-08c9ce21543a with Priority: HIGH for action security_group_rules [ 1086.204577] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 with Priority: HIGH for action security_group_rules [ 1086.204653] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ccf21c-eeb9-4add-8ed5-296070039162 with Priority: HIGH for action security_group_rules [ 1086.204744] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee with Priority: HIGH for action security_group_rules [ 1086.204831] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 with Priority: HIGH for action security_group_rules [ 1086.204917] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 with Priority: HIGH for action security_group_rules [ 1086.205008] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGH for action security_group_rules [ 1086.205852] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 with Priority: HIGH for action security_group_rules [ 1086.205972] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGH for action security_group_rules [ 1086.206150] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGH for action security_group_rules [ 1086.206317] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 with Priority: HIGH for action security_group_rules [ 1086.206436] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 with Priority: HIGH for action security_group_rules [ 1086.206534] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGH for action security_group_rules [ 1086.206739] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGH for action security_group_rules [ 1086.207095] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.207225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.207293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.207510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.207665] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.207768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.207823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.207974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.208070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.208164] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.209615] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.209615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.209615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.209615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.209615] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a68cfe0b-467e-482c-b4ec-3f99b4e37ecf',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.211413] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bade862-ff24-47f6-913c-4a011dd3df71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.211551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.211620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.211777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.211874] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bade862-ff24-47f6-913c-4a011dd3df71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.212641] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83c10e8c-149e-450b-b827-98a5e9d401e0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.212788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.212960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.213159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.213237] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83c10e8c-149e-450b-b827-98a5e9d401e0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.214075] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4339fe92-f605-41dc-aba6-ccecae77b024 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.214201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.214262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.214434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.214530] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4339fe92-f605-41dc-aba6-ccecae77b024',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.215254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9d6f11-6204-4093-b454-2cfd24b63dae taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.215489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.215669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.216204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.216537] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9d6f11-6204-4093-b454-2cfd24b63dae',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.217741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.217969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.218085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.218297] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.218377] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('646e01e7-0331-4a5c-9b1a-a3be54c1ee07',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.219302] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da99f927-2e97-469c-9968-08c9ce21543a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.219449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.219521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.219678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.219751] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da99f927-2e97-469c-9968-08c9ce21543a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.220825] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65e20f28-433e-4752-bdc0-b5f939f691d0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.221374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.222424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.222604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.222683] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65e20f28-433e-4752-bdc0-b5f939f691d0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.223480] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5ccf21c-eeb9-4add-8ed5-296070039162 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.223616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.224124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.224124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.224124] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5ccf21c-eeb9-4add-8ed5-296070039162',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.226307] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.226307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.226307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.226307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.226307] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54f8f8d4-52f2-44d4-ac27-8664220f43ee',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.226561] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83a8fa88-5bec-4b31-8608-ce09049bd610 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.226703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.226760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.227456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.227531] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83a8fa88-5bec-4b31-8608-ce09049bd610',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.228340] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82429466-a5a1-4b39-8d12-17fe5aa80977 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.228456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.228680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.228835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.228908] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82429466-a5a1-4b39-8d12-17fe5aa80977',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.230697] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.230801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.230855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.231022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.231084] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.233769] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4020162-d3ee-46af-a408-8b847c1e7ac2 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.233769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.233769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.233769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.233769] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4020162-d3ee-46af-a408-8b847c1e7ac2',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.233769] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.233769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.233769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.233769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.233769] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.234289] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.234289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.234289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.235107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.235107] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.237041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.237041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.237041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.237297] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.237297] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98809cbd-e3ae-4c26-8c2a-269a263d4ce9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.238315] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e2acfe-17af-4683-bd94-9fc47ded2886 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.238441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.238507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.238645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.238709] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e2acfe-17af-4683-bd94-9fc47ded2886',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.239424] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.239591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.239658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.239803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.239869] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.240795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.240918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.240984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.241107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.241171] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.247639] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.249401] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.273113] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.273303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.273369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.273593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.275469] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.275588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.277687] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.277687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.310384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.310717] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83c10e8c-149e-450b-b827-98a5e9d401e0 is going to be deleted. [ 1086.313460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.314150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.332331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.332537] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bade862-ff24-47f6-913c-4a011dd3df71 is going to be deleted. [ 1086.333540] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.333760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.352543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.352662] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a68cfe0b-467e-482c-b4ec-3f99b4e37ecf is going to be deleted. [ 1086.371631] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.371893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.371893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.372056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.372149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.372272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83c10e8c-149e-450b-b827-98a5e9d401e0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.381070] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.381070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.381070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.381253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.381416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.381452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bade862-ff24-47f6-913c-4a011dd3df71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.403455] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.403577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.403618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.403809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.403898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.404035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a68cfe0b-467e-482c-b4ec-3f99b4e37ecf" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.406066] env[66157]: INFO networking_nsxv3.common.synchronization [req-0d945e67-c48a-465a-bf4b-bbf8b329a05e req-9423d9ba-c75c-4440-a8c3-c6a3a815df02 tempest-MultipleCreateTestJSON-2091741498 tempest-MultipleCreateTestJSON-2091741498-project-member] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1086.406648] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1086.407017] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.407126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.746124] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.746124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.746124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.746124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.746124] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.746124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.746124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.746124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.746124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.746124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.746124] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.752752] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.753189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.754024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.754024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.754024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.754024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.754024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.754024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.754514] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.754709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.754907] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.759488] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.759755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.772394] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9bed370b-5a4e-4e78-98e5-e98e33a5c46a: rpc.has_security_group_logging(os_id): False [ 1086.774301] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.775471] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.778084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.778084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.778084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.778084] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.778084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.778084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.778084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.778084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.778084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.778084] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.796996] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.797251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.797251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.797494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.802516] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.802679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.805248] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.805356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.815183] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.815183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.815558] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.815657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.818030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.818109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.821099] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.821099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.827024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.827187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.828513] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.828617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.829504] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.829700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.830536] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.830624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.831248] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1086.831720] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.831867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.832726] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1086.833181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.833271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.834215] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1086.834646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.834755] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65e20f28-433e-4752-bdc0-b5f939f691d0 is going to be deleted. [ 1086.835748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.835957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.837464] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.837592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.855940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.856149] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5ccf21c-eeb9-4add-8ed5-296070039162 is going to be deleted. [ 1086.857054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.857277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.877908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.878051] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 646e01e7-0331-4a5c-9b1a-a3be54c1ee07 is going to be deleted. [ 1086.879016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.879236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.906641] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.906856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.907690] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.907829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.912596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.912736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4339fe92-f605-41dc-aba6-ccecae77b024 is going to be deleted. [ 1086.913734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.913939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.934979] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.934979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.941558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.941558] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54f8f8d4-52f2-44d4-ac27-8664220f43ee is going to be deleted. [ 1086.941558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.941558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.968818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.968818] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be deleted. [ 1086.968818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.968818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.979591] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.979739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.008469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.008658] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da99f927-2e97-469c-9968-08c9ce21543a is going to be deleted. [ 1087.009729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.009950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.036027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.036027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.036027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.036027] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4020162-d3ee-46af-a408-8b847c1e7ac2 is going to be deleted. [ 1087.036027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.036459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.114211] env[66157]: INFO networking_nsxv3.common.synchronization [req-637c6f8c-06a8-4c47-a44f-c51a416842e9 req-9334bcc1-a095-49b7-b8fa-36c3792be3c9 service nova] Enqueued Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_rules [ 1087.114211] env[66157]: INFO networking_nsxv3.common.synchronization [req-637c6f8c-06a8-4c47-a44f-c51a416842e9 req-9334bcc1-a095-49b7-b8fa-36c3792be3c9 service nova] Enqueued Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_members [ 1087.114348] env[66157]: INFO networking_nsxv3.common.synchronization [req-637c6f8c-06a8-4c47-a44f-c51a416842e9 req-9334bcc1-a095-49b7-b8fa-36c3792be3c9 service nova] Enqueued Resource ID: 1276a3be-8538-4d49-a8f9-38bfa4ccd5dc with Priority: HIGHEST for action port [ 1087.114870] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_rules [ 1087.115014] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_members [ 1087.115147] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1276a3be-8538-4d49-a8f9-38bfa4ccd5dc with Priority: HIGHEST for action port [ 1087.115456] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe07656-65ae-471b-953b-0e7810aed7b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.115579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.115646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.115939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.115939] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.116852] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe07656-65ae-471b-953b-0e7810aed7b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.116981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.117058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.117237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.117387] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.117478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.117611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.117846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.117985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.118138] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.118967] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.119094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.119142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.119673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.119673] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1276a3be-8538-4d49-a8f9-38bfa4ccd5dc',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.127615] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.127770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.151999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.152170] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98809cbd-e3ae-4c26-8c2a-269a263d4ce9 is going to be deleted. [ 1087.153401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.153630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.187466] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.187691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.193751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.193966] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e2acfe-17af-4683-bd94-9fc47ded2886 is going to be deleted. [ 1087.194992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.195393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.195546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.195946] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.196162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.196268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.196499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.196619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.196785] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a is going to be created. [ 1087.198358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.198583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.198691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.198777] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 is going to be deleted. [ 1087.199609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.199777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.253056] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.253056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.253369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.253369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.253589] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.253735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.253794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.254225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.254225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.254225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.254486] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.254486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.254590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.254671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.254858] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.254965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.255058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.255247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.255331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.255408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.255495] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.257607] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.257769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.266588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.266781] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9d6f11-6204-4093-b454-2cfd24b63dae is going to be deleted. [ 1087.268061] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.269381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.269611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.269694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.269982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65e20f28-433e-4752-bdc0-b5f939f691d0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.270234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.270465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.270602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.270781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5ccf21c-eeb9-4add-8ed5-296070039162" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.272053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.272053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.272053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.272053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-646e01e7-0331-4a5c-9b1a-a3be54c1ee07" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.272514] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.272673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.272754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.272878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4339fe92-f605-41dc-aba6-ccecae77b024" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.273522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.273522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.273522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.273522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54f8f8d4-52f2-44d4-ac27-8664220f43ee" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.273812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.273812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.273812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.274024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.274024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.274206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.274253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.274342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da99f927-2e97-469c-9968-08c9ce21543a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.274464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.274599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.285423] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.285679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.285679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.285887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.286260] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.286374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.286433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.286605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.286689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.286774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.286922] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.287024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.287086] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.287230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.287367] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.287475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.287535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.287631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.287707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.287784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.287871] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.288903] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.289042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.289087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.289234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.289424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.289570] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1087.302237] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.302450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.337531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.337726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.359194] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.359357] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82429466-a5a1-4b39-8d12-17fe5aa80977 is going to be deleted. [ 1087.360300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.360791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.360791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.360791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4020162-d3ee-46af-a408-8b847c1e7ac2" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.360978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.361034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.361127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.361908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98809cbd-e3ae-4c26-8c2a-269a263d4ce9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.361908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.361908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.362134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.362134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.390132] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.390351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.390351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.390510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.390664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.408864] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1087.414906] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.415063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.415192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.416308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.416308] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.417323] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.417442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.417524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.417722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.417807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.417911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e2acfe-17af-4683-bd94-9fc47ded2886" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.459299] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.459443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.459516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.459712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.459855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.459960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9d6f11-6204-4093-b454-2cfd24b63dae" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.476676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.476892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.476965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.477217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.477313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.477464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82429466-a5a1-4b39-8d12-17fe5aa80977" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.480324] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1087.480794] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a in Status: IN_PROGRESS for 2s [ 1087.622084] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe07656-65ae-471b-953b-0e7810aed7b9 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.622548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.623252] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.625325] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1276a3be-8538-4d49-a8f9-38bfa4ccd5dc with status ACTIVE [ 1087.625644] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.626483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.626483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.626483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.626699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.627151] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.627774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.627774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.627988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.628092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.628355] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.628720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.628720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.628985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.629159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.629322] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1276a3be-8538-4d49-a8f9-38bfa4ccd5dc is going to be updated. [ 1087.652452] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.652730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.652730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.652870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.653019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.653193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1276a3be-8538-4d49-a8f9-38bfa4ccd5dc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.759034] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a3d86b0-5e47-4031-aa77-b1a917545a8b: rpc.has_security_group_logging(os_id): False [ 1087.771537] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2381db7b-1b29-4dfc-a6af-48c498e3e0b0: rpc.has_security_group_logging(os_id): False [ 1087.781691] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.782905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.782905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.783477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.792887] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 1087.812135] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.812135] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.815678] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.816747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.816747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.817099] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.817383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.817383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.817479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.817479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.817679] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.817790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.817835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.818147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.818147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.818266] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.818353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.818440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.818547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.818613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.818708] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be updated. [ 1087.820309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.820309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.844342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.844714] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.844849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.845792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.845792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.845792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.845792] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1087.846956] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.847923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.871197] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.871578] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.871712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.871763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.871980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.872076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.872300] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.872390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.872445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.872595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.872663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.873191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.873191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.873191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.873326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.873364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.873448] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1087.897248] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.897404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.897476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.897715] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.897861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.921021] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1087.924680] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.924680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.924680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.924680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.924680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.942402] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.942602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.942642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.942831] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.942973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.945767] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1087.986699] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1088.032680] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 in Status: SUCCESS [ 1088.032680] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83a8fa88-5bec-4b31-8608-ce09049bd610 deletion is rescheduled due to dependency. [ 1088.032680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83a8fa88-5bec-4b31-8608-ce09049bd610" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.132075] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.420582] env[66157]: INFO networking_nsxv3.common.synchronization [req-318d519b-55a4-4d2d-acf1-4f7feef7517f req-965a7cad-8d65-4626-b915-3b880e85e8b1 tempest-ServerRescueNegativeTestJSON-2006998581 tempest-ServerRescueNegativeTestJSON-2006998581-project-member] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 1088.421183] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 1088.421544] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.421697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.421767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.421995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.422169] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.422266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.422322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.422479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.422557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.422649] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.634895] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.635066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.635206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.635440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.635528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.635629] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe07656-65ae-471b-953b-0e7810aed7b9 is going to be created. [ 1088.663656] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.663803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.663870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.664219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.664301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.674626] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe07656-65ae-471b-953b-0e7810aed7b9 in Status: UNINITIALIZED for 2s [ 1088.925347] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.423097] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1089.423097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.423097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.423097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.423097] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.423097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.423097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.423097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.423097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.423097] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.431323] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.495982] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a in Status: SUCCESS [ 1089.496224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.745832] env[66157]: INFO networking_nsxv3.common.synchronization [None req-c630a73a-724f-4538-846c-b562ef37a495 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_rules [ 1089.746579] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_rules [ 1089.746963] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.747116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.747188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.747472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.749239] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.866706] env[66157]: INFO networking_nsxv3.common.synchronization [None req-34ed9d17-bce6-4889-9b0f-84d24575434d tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_rules [ 1089.867083] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_rules [ 1089.867428] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.867540] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.928509] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.928678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.929208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.929208] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.934459] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.934459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.934571] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.934709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.934795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.934933] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be updated. [ 1089.946105] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1089.946279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.962322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.962322] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.962322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.962322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.962322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.962322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.962322] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1089.962322] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1089.962322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.980038] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.980207] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.980242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.980445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.980588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.989386] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: IN_PROGRESS for 2s [ 1090.001805] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.002052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.002052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.002397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.002397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.006114] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1090.006486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.011320] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1090.273589] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.273771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.273844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.274095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.274192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.274372] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 already deleted. [ 1090.274468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.274635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.274809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.274905] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.687705] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe07656-65ae-471b-953b-0e7810aed7b9 in Status: SUCCESS [ 1090.687969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.688403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.688450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.688642] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.689136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.689136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.689136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.689224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.689248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.689454] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.801610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.801610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.801610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.801819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.801819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.801819] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 already deleted. [ 1090.802059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.193302] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.698409] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe07656-65ae-471b-953b-0e7810aed7b9: rpc.has_security_group_logging(os_id): False [ 1091.723650] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.723650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.723650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.723650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.723650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.723650] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.723991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.723991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.723991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.723991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.724101] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe07656-65ae-471b-953b-0e7810aed7b9 is going to be created. [ 1091.794487] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.794487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.794487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.794487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.794487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.806795] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe07656-65ae-471b-953b-0e7810aed7b9 in Status: IN_PROGRESS for 2s [ 1092.000558] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: SUCCESS [ 1092.000558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.021915] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1092.021915] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be deletion is rescheduled due to dependency. [ 1092.021915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.021915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.021915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.022140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.022140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.022140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.022287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.022373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.022473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.022560] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.214481] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0058810d-d57f-4e8f-b6e6-3e5849c8e3fe None None] Enqueued Resource ID: c0edbe1b-7db5-47f8-a611-d31d2eb8e48f with Priority: HIGHEST for action port [ 1092.215163] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0edbe1b-7db5-47f8-a611-d31d2eb8e48f with Priority: HIGHEST for action port [ 1092.215503] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0edbe1b-7db5-47f8-a611-d31d2eb8e48f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.215628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0edbe1b-7db5-47f8-a611-d31d2eb8e48f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.215710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0edbe1b-7db5-47f8-a611-d31d2eb8e48f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.215959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0edbe1b-7db5-47f8-a611-d31d2eb8e48f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.216085] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0edbe1b-7db5-47f8-a611-d31d2eb8e48f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.524713] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.524877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.524950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.525334] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.525537] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.525647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.525721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.525871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.525970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.526219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.526436] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.526538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.526595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.526744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.527283] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.527283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.527283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.527283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.527283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.527480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.527480] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.718774] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0edbe1b-7db5-47f8-a611-d31d2eb8e48f [ 1092.719120] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.719870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.719870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.719870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.719870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.719870] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0edbe1b-7db5-47f8-a611-d31d2eb8e48f already deleted. [ 1092.719870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0edbe1b-7db5-47f8-a611-d31d2eb8e48f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.036463] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16ef380f-fc6a-4b09-a172-185ed835a4be: rpc.has_security_group_logging(os_id): False [ 1093.061385] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.061520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.061586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.061807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.061892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.062156] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.062245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.062335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.062435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.062479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.062654] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.062740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.064048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.064048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.064048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.064048] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.064048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.064048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.064048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.064048] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.064048] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1093.144511] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.144511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.144511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.144511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.144511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.161713] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1093.616466] env[66157]: INFO networking_nsxv3.common.synchronization [req-214c576b-85ff-4221-a3b8-2f87d35b7747 req-921650dc-65d4-4227-b7a1-de1d4bbd4f56 tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1093.617176] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1093.617565] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.617695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.617764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.617969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.618159] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.618336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.618406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.618554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.618642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.618788] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.822519] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe07656-65ae-471b-953b-0e7810aed7b9 in Status: SUCCESS [ 1093.822519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.128531] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.128696] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.128765] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.129009] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.155468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.155726] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.155844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.155911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.156199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.156199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.156309] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1094.189122] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.189122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.189122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.189122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.189122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.199638] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1095.176292] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1095.176292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.209848] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 4s [ 1098.221295] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1098.221588] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 1098.221588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.618481] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1098.618578] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1103.619401] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1103.619642] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1107.162686] env[66157]: INFO networking_nsxv3.common.synchronization [req-9f8cab75-79f9-403a-923e-1e27936ed579 req-0d52aa3e-e684-479c-a665-b61e6710f9de tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1107.162919] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1107.163214] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.163332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.163416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.163653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.163830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.163981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.164059] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.164250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.164353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.164464] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.314036] env[66157]: INFO networking_nsxv3.common.synchronization [req-73920543-ecf3-4839-9469-f73d2d01b84f req-f7c8dc19-3831-44a1-8444-4366de2c79a7 tempest-ServerRescueNegativeTestJSON-2006998581 tempest-ServerRescueNegativeTestJSON-2006998581-project-member] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 1107.314439] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGHEST for action security_group_members [ 1107.315499] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.315499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.315499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.315815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.315815] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.315987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.315987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.316381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.316381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.316550] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.535511] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-955 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.535713] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.535837] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.536122] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.536386] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.536544] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.536660] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.536869] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.537026] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.537240] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.537352] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.537460] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.537566] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.537671] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.538023] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.538023] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.558375] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.558596] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.558720] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.558852] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-955" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.559206] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-987af153-b294-415a-ab5b-9e68f5ee6fa5 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.559565] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-987af153-b294-415a-ab5b-9e68f5ee6fa5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.559565] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-987af153-b294-415a-ab5b-9e68f5ee6fa5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.559834] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-987af153-b294-415a-ab5b-9e68f5ee6fa5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.559948] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987af153-b294-415a-ab5b-9e68f5ee6fa5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.666956] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.818398] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.818537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.818603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.818826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.914217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.914217] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.914217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.914217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.914217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.914217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.914464] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be updated. [ 1107.940278] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.940432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.940432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.940607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.940752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.949955] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: IN_PROGRESS for 2s [ 1108.062360] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.062578] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.062703] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.062996] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.063163] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.063316] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 987af153-b294-415a-ab5b-9e68f5ee6fa5 not found, creating... [ 1108.063565] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.063719] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.063835] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.064059] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.064196] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.064473] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.064624] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.064833] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.065154] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.065305] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.065452] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 987af153-b294-415a-ab5b-9e68f5ee6fa5 is going to be created. [ 1108.086031] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.086235] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.086349] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.086624] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.086845] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.087096] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-987af153-b294-415a-ab5b-9e68f5ee6fa5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.169419] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.673109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.673109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.673109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.673109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.673543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.673543] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1108.701212] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.701357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.701411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.701626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.701774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.712472] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1108.789658] env[66157]: INFO networking_nsxv3.common.synchronization [req-9f8cab75-79f9-403a-923e-1e27936ed579 req-30103438-2e4d-40ee-9342-37629872d9a1 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 1108.789844] env[66157]: INFO networking_nsxv3.common.synchronization [req-9f8cab75-79f9-403a-923e-1e27936ed579 req-30103438-2e4d-40ee-9342-37629872d9a1 service nova] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1108.790038] env[66157]: INFO networking_nsxv3.common.synchronization [req-9f8cab75-79f9-403a-923e-1e27936ed579 req-30103438-2e4d-40ee-9342-37629872d9a1 service nova] Enqueued Resource ID: 987af153-b294-415a-ab5b-9e68f5ee6fa5 with Priority: HIGHEST for action port [ 1108.790540] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_rules [ 1108.790675] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1108.790777] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 987af153-b294-415a-ab5b-9e68f5ee6fa5 with Priority: HIGHEST for action port [ 1108.791910] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.792083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.792166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.792538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.792639] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.793561] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.793657] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.794585] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-987af153-b294-415a-ab5b-9e68f5ee6fa5 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.794585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-987af153-b294-415a-ab5b-9e68f5ee6fa5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.794585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-987af153-b294-415a-ab5b-9e68f5ee6fa5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.794585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-987af153-b294-415a-ab5b-9e68f5ee6fa5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.794585] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987af153-b294-415a-ab5b-9e68f5ee6fa5',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.297813] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.298155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.298155] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 987af153-b294-415a-ab5b-9e68f5ee6fa5 with status ACTIVE [ 1109.298380] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.298515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.298601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.298856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.298987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.299207] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.299328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.299408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.299579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.299676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.299881] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.300011] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.300128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.300281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.300354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.300438] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 987af153-b294-415a-ab5b-9e68f5ee6fa5 is going to be updated. [ 1109.324796] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.325094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.325140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.325388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.325552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.326138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-987af153-b294-415a-ab5b-9e68f5ee6fa5" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.527581] env[66157]: INFO networking_nsxv3.common.synchronization [req-b432d8a7-baed-4b50-bb32-256513670a37 req-f6a2cb4e-e122-48c8-bb8b-2d37dec3d6b0 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_members [ 1109.528267] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_members [ 1109.528594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dae1e84-05f3-49da-b3a4-8d3f4e788988 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.528730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.528798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.529061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.529225] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.529325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.529385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.529518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.529615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.529690] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.889060] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-869 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.889293] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.889418] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.889696] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.891022] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.891022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.891022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.891022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.891022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.891022] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.891418] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.891418] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.891418] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.891560] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.891560] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.891694] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.912989] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.913197] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.913343] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.913520] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-869" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.913850] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-b3038fc5-f416-45d7-8d44-5c6746fd6225 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.914034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-b3038fc5-f416-45d7-8d44-5c6746fd6225" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.914157] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-b3038fc5-f416-45d7-8d44-5c6746fd6225" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.914524] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-b3038fc5-f416-45d7-8d44-5c6746fd6225" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.914671] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3038fc5-f416-45d7-8d44-5c6746fd6225',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.961106] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 in Status: SUCCESS [ 1109.961270] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 deletion is rescheduled due to dependency. [ 1109.961459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.032365] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.032528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.032591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.032816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.032980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.033226] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.033351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.033402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.033574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.033678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.033784] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 already deleted. [ 1110.033943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.418552] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.418552] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.418955] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.418994] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.419286] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.419525] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port b3038fc5-f416-45d7-8d44-5c6746fd6225 not found, creating... [ 1110.420748] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.420748] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.420748] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.420748] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.420748] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.421217] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.421472] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.421671] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.421967] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.422196] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.422414] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: b3038fc5-f416-45d7-8d44-5c6746fd6225 is going to be created. [ 1110.447718] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.447978] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.448223] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.448610] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.448909] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.449275] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-b3038fc5-f416-45d7-8d44-5c6746fd6225" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.722438] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1110.722679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.722888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.723125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.723343] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.723464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.723529] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.723682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.723764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.723859] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.175235] env[66157]: INFO networking_nsxv3.common.synchronization [req-b432d8a7-baed-4b50-bb32-256513670a37 req-19debf85-0c72-4a7d-a76c-0466700e2427 service nova] Enqueued Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_rules [ 1111.177997] env[66157]: INFO networking_nsxv3.common.synchronization [req-b432d8a7-baed-4b50-bb32-256513670a37 req-19debf85-0c72-4a7d-a76c-0466700e2427 service nova] Enqueued Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_members [ 1111.177997] env[66157]: INFO networking_nsxv3.common.synchronization [req-b432d8a7-baed-4b50-bb32-256513670a37 req-19debf85-0c72-4a7d-a76c-0466700e2427 service nova] Enqueued Resource ID: b3038fc5-f416-45d7-8d44-5c6746fd6225 with Priority: HIGHEST for action port [ 1111.177997] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_rules [ 1111.177997] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_members [ 1111.177997] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3038fc5-f416-45d7-8d44-5c6746fd6225 with Priority: HIGHEST for action port [ 1111.177997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.177997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.177997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.178442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.178442] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.179386] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dae1e84-05f3-49da-b3a4-8d3f4e788988 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.182024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.182024] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.182024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3038fc5-f416-45d7-8d44-5c6746fd6225 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3038fc5-f416-45d7-8d44-5c6746fd6225" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.182024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3038fc5-f416-45d7-8d44-5c6746fd6225" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.182737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3038fc5-f416-45d7-8d44-5c6746fd6225" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.182737] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3038fc5-f416-45d7-8d44-5c6746fd6225',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.226725] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.684570] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.685932] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dae1e84-05f3-49da-b3a4-8d3f4e788988 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.686092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.686346] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3038fc5-f416-45d7-8d44-5c6746fd6225 with status ACTIVE [ 1111.686550] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.686668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.686744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.686968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.687116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.687321] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.687441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.687554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.687681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.687762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.688235] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.688394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.688485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.688593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.688672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.688768] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3038fc5-f416-45d7-8d44-5c6746fd6225 is going to be updated. [ 1111.714750] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.714981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.715114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.715397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.715585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.715779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3038fc5-f416-45d7-8d44-5c6746fd6225" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.728805] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.191251] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.232089] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.232362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.232362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.232691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.232859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.232993] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1112.270604] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.270604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.271042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.271042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.271042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.282224] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1112.693931] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.693931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.693931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.694324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.694324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.694324] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 is going to be created. [ 1112.720074] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.720291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.720291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.720587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.720777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.731433] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 in Status: UNINITIALIZED for 2s [ 1114.292785] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1114.293075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.293450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.293716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.293948] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.294162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.294256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.294441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.294549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.294722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.294843] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.741533] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 in Status: SUCCESS [ 1114.741771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.741943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.742166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.742354] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.742460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.742521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.742768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.742843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.742923] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.743019] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.797082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.797270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.797329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.797550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.797714] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.797833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.797899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.798058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.798158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.798253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.798431] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.798532] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.798593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.798751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.798937] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.799057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.799121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.799383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.799383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.799483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.799511] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.245891] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.304165] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00106a4a-ef70-4397-a8b9-afffa44e977b: rpc.has_security_group_logging(os_id): False [ 1115.325951] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.326120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.326186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.326673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.326673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.326799] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.326799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.326885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.327095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.327192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.327313] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.327413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.327491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.329149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.329149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.329149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.329149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.329149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.329149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.329149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.329149] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1115.418429] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.418637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.418666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.418893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.419128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.441036] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1115.748504] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1dae1e84-05f3-49da-b3a4-8d3f4e788988: rpc.has_security_group_logging(os_id): False [ 1115.768081] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.768081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.768309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.768397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.768500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.768810] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.768972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.769151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.769399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.769485] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.769576] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 is going to be created. [ 1115.835295] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.835479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.835479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.835629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.835816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.847904] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 in Status: IN_PROGRESS for 2s [ 1116.178833] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1116.178934] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1116.185302] env[66157]: INFO networking_nsxv3.common.synchronization [req-e5e05292-3439-46be-a7b6-68368a213cc7 req-e1b2c1f9-4d17-4989-a9d7-b433ed92ac00 tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1116.185769] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1116.186083] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.186203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.186289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.186515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.186838] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.187025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.187025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.187178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.187264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.187358] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.365195] env[66157]: INFO networking_nsxv3.common.synchronization [req-fb79ba2d-0e70-45fb-962b-77178886c199 req-f818c576-c41a-482d-9c43-2fdb0f88e000 tempest-ServerActionsV293TestJSON-294038275 tempest-ServerActionsV293TestJSON-294038275-project-member] Enqueued Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_members [ 1116.365195] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGHEST for action security_group_members [ 1116.365847] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.366285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.366504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.369062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.369062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.369062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.369062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.369062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.369062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.369062] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.589809] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.591377] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.591377] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.591377] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.591377] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.591633] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.591633] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.591951] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.592120] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.592336] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.592449] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.592628] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.592822] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.593052] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.593159] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.593266] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.625248] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.625248] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.625248] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.625248] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.625248] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.625248] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.625248] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.625248] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.625248] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f34a326-faa8-40a4-8e1b-8fcc576dcd32',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.691071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.691388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.691567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.691908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.692120] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.692432] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.692594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.692700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.692952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.693094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.693232] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1116.728646] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.728870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.728974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.729282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.729510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.743900] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1116.872224] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.872526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.872526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.872803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.906219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.906564] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.906859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.906859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.907045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.907139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.907235] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d is going to be updated. [ 1116.947439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.947735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.947735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.947922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.948070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.960151] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d in Status: IN_PROGRESS for 2s [ 1117.127169] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.127445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.127657] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.127899] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.128138] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.128314] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 3f34a326-faa8-40a4-8e1b-8fcc576dcd32 not found, creating... [ 1117.128602] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.128849] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.128971] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.129226] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.129367] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.129670] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.129827] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.129940] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.130178] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.130315] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.130507] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 3f34a326-faa8-40a4-8e1b-8fcc576dcd32 is going to be created. [ 1117.155422] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.155641] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.155809] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.156145] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.156379] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.156600] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.461707] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1117.462056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.860942] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 in Status: SUCCESS [ 1117.862758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.907823] env[66157]: INFO networking_nsxv3.common.synchronization [req-e5e05292-3439-46be-a7b6-68368a213cc7 req-ea4c01b9-8136-463f-8483-4be0a16c9e49 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 1117.907823] env[66157]: INFO networking_nsxv3.common.synchronization [req-e5e05292-3439-46be-a7b6-68368a213cc7 req-ea4c01b9-8136-463f-8483-4be0a16c9e49 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1117.908253] env[66157]: INFO networking_nsxv3.common.synchronization [req-e5e05292-3439-46be-a7b6-68368a213cc7 req-ea4c01b9-8136-463f-8483-4be0a16c9e49 service nova] Enqueued Resource ID: 3f34a326-faa8-40a4-8e1b-8fcc576dcd32 with Priority: HIGHEST for action port [ 1117.908743] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 1117.908743] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1117.908865] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f34a326-faa8-40a4-8e1b-8fcc576dcd32 with Priority: HIGHEST for action port [ 1117.909153] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.909362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.910248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.910440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.910539] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.911738] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.911738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.911953] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.913179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.913260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.913447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.913529] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f34a326-faa8-40a4-8e1b-8fcc576dcd32',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.416345] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.416546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.416957] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f34a326-faa8-40a4-8e1b-8fcc576dcd32 with status ACTIVE [ 1118.420127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.420127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.420127] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.420127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.420127] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f34a326-faa8-40a4-8e1b-8fcc576dcd32 is going to be updated. [ 1118.447091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.447215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.447250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.447488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.447645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.447839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f34a326-faa8-40a4-8e1b-8fcc576dcd32" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.628339] env[66157]: INFO networking_nsxv3.common.synchronization [req-1558bbb3-72ed-4396-bf7e-ed735f6fd553 req-459b0e56-9d74-45ab-8560-91e0d5ff8d47 tempest-MultipleCreateTestJSON-2091741498 tempest-MultipleCreateTestJSON-2091741498-project-member] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1118.629879] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1118.630345] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.630606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.630606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.630785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.630947] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.631082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.631145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.631340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.631409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.631507] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.754413] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1118.754704] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 1118.754896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.755038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.755278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.755487] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.755630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.755728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.755908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.755999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.756177] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.974018] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d in Status: SUCCESS [ 1118.977378] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d deletion is rescheduled due to dependency. [ 1118.977378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.045891] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.045891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.045891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.045891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.045891] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.045891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.045891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.045891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.045891] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.045891] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.045891] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.046367] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.046367] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.046367] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.046367] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.046480] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.066482] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.066730] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1119.066993] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.067256] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.067604] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-dd154997-4e35-4d3d-a9ac-506461f43e86 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.067864] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-dd154997-4e35-4d3d-a9ac-506461f43e86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.068021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-dd154997-4e35-4d3d-a9ac-506461f43e86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.068361] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-dd154997-4e35-4d3d-a9ac-506461f43e86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.068531] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd154997-4e35-4d3d-a9ac-506461f43e86',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.134762] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.135591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.135591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.135591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.135591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.135591] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.136084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.136084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.136157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.137217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.137364] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1119.165334] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.165435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.165528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.165745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.165902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.179838] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1119.261490] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.571795] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.572165] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.572285] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.572670] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.572873] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.573071] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port dd154997-4e35-4d3d-a9ac-506461f43e86 not found, creating... [ 1119.573912] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.573912] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.573912] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.574108] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.574138] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.574485] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.574700] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.574842] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.575164] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.575350] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.575536] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: dd154997-4e35-4d3d-a9ac-506461f43e86 is going to be created. [ 1119.599576] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.599576] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.599576] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.599831] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.599831] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.600086] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-dd154997-4e35-4d3d-a9ac-506461f43e86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.763609] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.266512] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.266665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.267122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.269939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.269939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.269939] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1120.312671] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.312745] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.312775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.314212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.314212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.329972] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1120.361755] env[66157]: INFO networking_nsxv3.common.synchronization [req-1558bbb3-72ed-4396-bf7e-ed735f6fd553 req-2ddffb57-1c28-44ed-9d3b-1eafe00efd78 service nova] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_rules [ 1120.361755] env[66157]: INFO networking_nsxv3.common.synchronization [req-1558bbb3-72ed-4396-bf7e-ed735f6fd553 req-2ddffb57-1c28-44ed-9d3b-1eafe00efd78 service nova] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1120.361755] env[66157]: INFO networking_nsxv3.common.synchronization [req-1558bbb3-72ed-4396-bf7e-ed735f6fd553 req-2ddffb57-1c28-44ed-9d3b-1eafe00efd78 service nova] Enqueued Resource ID: dd154997-4e35-4d3d-a9ac-506461f43e86 with Priority: HIGHEST for action port [ 1120.361755] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_rules [ 1120.361755] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1120.361755] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd154997-4e35-4d3d-a9ac-506461f43e86 with Priority: HIGHEST for action port [ 1120.361755] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.362289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.362513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.362876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.363085] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.365443] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.365784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.366212] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd154997-4e35-4d3d-a9ac-506461f43e86 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.366553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd154997-4e35-4d3d-a9ac-506461f43e86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.366708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd154997-4e35-4d3d-a9ac-506461f43e86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.367875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd154997-4e35-4d3d-a9ac-506461f43e86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.367875] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd154997-4e35-4d3d-a9ac-506461f43e86',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.866105] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.866613] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.869857] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd154997-4e35-4d3d-a9ac-506461f43e86 with status ACTIVE [ 1120.870171] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.870315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.870392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.870678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.870746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.870949] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.871075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.871140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.871307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.871445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.871618] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.871722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.871783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.871922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.872015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.872103] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd154997-4e35-4d3d-a9ac-506461f43e86 is going to be updated. [ 1120.899555] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.899766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.899862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.900176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.900345] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.900522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd154997-4e35-4d3d-a9ac-506461f43e86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.077660] env[66157]: INFO networking_nsxv3.common.synchronization [req-1558bbb3-72ed-4396-bf7e-ed735f6fd553 req-33e6a9ab-402f-4a23-b45e-11023e2211d6 tempest-MultipleCreateTestJSON-2091741498 tempest-MultipleCreateTestJSON-2091741498-project-member] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1121.078266] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1121.078597] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.078698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.192893] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1121.192893] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be deletion is rescheduled due to dependency. [ 1121.192893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.192893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.193021] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.193263] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.193263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.193426] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.194370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.194370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.194370] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.414088] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.414411] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.414687] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.415102] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.415527] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.415714] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.415829] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.416071] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.416341] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.416414] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.416529] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.416634] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.416739] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.416849] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.416979] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.417110] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.436221] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.436388] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1121.436518] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.436699] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-61" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.437045] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-3e1da340-4e8c-4954-824f-7aa2239638e9 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.437225] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-3e1da340-4e8c-4954-824f-7aa2239638e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.437345] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-3e1da340-4e8c-4954-824f-7aa2239638e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.437680] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-3e1da340-4e8c-4954-824f-7aa2239638e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.437816] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1da340-4e8c-4954-824f-7aa2239638e9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.696337] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.940465] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.940465] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.940465] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.940903] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.940903] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.941114] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 3e1da340-4e8c-4954-824f-7aa2239638e9 not found, creating... [ 1121.941430] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.941591] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.941719] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.941949] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.942510] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.942510] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.942919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.942919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.942919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.943141] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.943176] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 3e1da340-4e8c-4954-824f-7aa2239638e9 is going to be created. [ 1121.967567] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.967781] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.967909] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.968218] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.968451] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.968841] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-3e1da340-4e8c-4954-824f-7aa2239638e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.199688] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.345920] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1122.346192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.346395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.346620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.346880] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.347042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.347565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.347779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.347916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.348347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.348496] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.703890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.703890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.703890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.703890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.703890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.703890] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1122.734044] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.734408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.734695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.736864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.736864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.748073] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1122.852170] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.852170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.852170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.852170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.852170] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.852170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.852170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.852170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.852170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.852170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.852170] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.852741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.852741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.852741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.852741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.852741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.852898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.852898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.853015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.853058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.854052] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.165915] env[66157]: INFO networking_nsxv3.common.synchronization [req-1558bbb3-72ed-4396-bf7e-ed735f6fd553 req-2518337d-de48-4b69-8492-0c892a3db870 service nova] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_rules [ 1123.166240] env[66157]: INFO networking_nsxv3.common.synchronization [req-1558bbb3-72ed-4396-bf7e-ed735f6fd553 req-2518337d-de48-4b69-8492-0c892a3db870 service nova] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1123.166346] env[66157]: INFO networking_nsxv3.common.synchronization [req-1558bbb3-72ed-4396-bf7e-ed735f6fd553 req-2518337d-de48-4b69-8492-0c892a3db870 service nova] Enqueued Resource ID: 3e1da340-4e8c-4954-824f-7aa2239638e9 with Priority: HIGHEST for action port [ 1123.167133] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_rules [ 1123.167270] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1123.167423] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e1da340-4e8c-4954-824f-7aa2239638e9 with Priority: HIGHEST for action port [ 1123.167748] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.167855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.168069] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.169087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.169334] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e1da340-4e8c-4954-824f-7aa2239638e9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.169446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e1da340-4e8c-4954-824f-7aa2239638e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.169515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e1da340-4e8c-4954-824f-7aa2239638e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.169809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e1da340-4e8c-4954-824f-7aa2239638e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.169905] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1da340-4e8c-4954-824f-7aa2239638e9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.355865] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94: rpc.has_security_group_logging(os_id): False [ 1123.379155] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.379155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.380626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.382749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.382749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.383029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.383151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.383417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.383417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.383752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.383927] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.383927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.386024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.386947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.387210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.387559] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.387801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.387944] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.388245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.388432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.388627] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1123.467893] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.468107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.468157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.468349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.468502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.484820] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1123.674299] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e1da340-4e8c-4954-824f-7aa2239638e9 with status ACTIVE [ 1123.674999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.674999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.674999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.674999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.675204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.675232] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.675352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.675418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.675615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.675696] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.675857] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.675945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.676030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.676179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.676238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.676321] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e1da340-4e8c-4954-824f-7aa2239638e9 is going to be updated. [ 1123.701023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.701023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.701023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.701023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.701023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.701023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e1da340-4e8c-4954-824f-7aa2239638e9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.762377] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1124.762679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.762873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.763698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.763698] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.763698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.763698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.763698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.763698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.763975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.763975] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.764741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.764924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.767270] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.767889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.767889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.767889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.768043] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.768074] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.270697] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.271072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.271330] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.499681] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1125.499969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.774069] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.138072] env[66157]: INFO networking_nsxv3.common.synchronization [req-c85ec152-06e8-4b90-853b-7860bba4a697 req-4646d339-5bfd-497f-b45b-d5dc675f099c tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1126.138072] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1126.138072] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.138072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.138072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.138072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.139340] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.139638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.139815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.140150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.140458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.140918] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.277023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.277215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.277257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.277483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.277575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.277681] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1126.310638] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.310906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.311028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.311198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.311437] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.324379] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1126.643623] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.145728] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.648056] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.648238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.648315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.648536] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.648632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.648729] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1127.686145] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.686533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.686644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.686870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.687079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.696946] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1128.004333] env[66157]: INFO networking_nsxv3.common.synchronization [req-0f08e2e1-1058-4d56-b6d2-2297ed7eefd2 req-28b1d5e6-5efb-412c-98d9-def684cca22f tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1128.004706] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1128.004887] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.005034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.005101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.005385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.005543] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.005642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.005692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.005854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.006116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.006116] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.335487] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1128.335827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.335971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.336268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.336520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.336718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.336846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.337582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.337582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.337582] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.508850] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.509051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.509098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.509321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.509414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.509658] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.509741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.509799] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.509960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.510047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.510131] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1128.537885] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.538168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.538257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.538474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.538672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.549477] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1128.839753] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.342168] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.712228] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1129.712608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.846063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.846063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.846063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.846063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.846063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.846340] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1129.878788] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.878960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.879019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.880038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.880038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.892929] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1130.560865] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1130.561331] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 deletion is rescheduled due to dependency. [ 1130.561331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.907220] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1131.907572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.907766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.908100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.908408] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.908589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.908697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.908963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.909131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.909290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.909553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.909728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.909841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.910095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.910327] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.910494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.910614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.910875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.911051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.911212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.911394] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.413920] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16ef380f-fc6a-4b09-a172-185ed835a4be: rpc.has_security_group_logging(os_id): False [ 1132.436884] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.436884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.436884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.437206] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.437358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.437776] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.437933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.437971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.438243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.438379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.438690] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.438852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.438928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.439150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.439292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.439601] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.439773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.439919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.440121] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.440489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.440489] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1132.531313] env[66157]: INFO networking_nsxv3.common.synchronization [req-c0ea62f9-2827-4eda-96f4-113a83fe9cc4 req-4b512422-ea31-4b24-a273-2869246c5893 tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1132.531313] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1132.531313] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.531313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.531313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.531313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.531313] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.531313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.531313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.531313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.531313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.531313] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.538477] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.538711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.538817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.539161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.541441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.558147] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1133.033309] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.033624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.033769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.034009] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.034151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.034445] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.034608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.034797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.034992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.035130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.035271] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1133.074842] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.074842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.074842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.075215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.075215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.086754] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1133.679666] env[66157]: INFO networking_nsxv3.common.synchronization [req-448c920b-5cbb-45fe-a82c-4fb4798ae4a9 req-7494bfdf-b701-4ee5-a516-b6d8d8cd2bbc tempest-ServersTestFqdnHostnames-1310601545 tempest-ServersTestFqdnHostnames-1310601545-project-member] Enqueued Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_members [ 1133.680310] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGHEST for action security_group_members [ 1133.680603] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-4120ed87-fb96-4685-aabd-90a91df342cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.680723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.680773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.680970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.684045] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.684045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.684045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.684045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.684045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.684045] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.756826] env[66157]: INFO networking_nsxv3.common.synchronization [req-95d756cb-b018-4014-be99-b7eca6c126d9 req-06752c48-8e4e-4e18-a4b2-f068eade3c20 tempest-ServersTestJSON-331860507 tempest-ServersTestJSON-331860507-project-member] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1133.757522] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGHEST for action security_group_members [ 1133.757970] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.759637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.759637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.759637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.759637] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.759637] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.759977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.760239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.760321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.760526] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.186424] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.186756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.186756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.187028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.212355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.212687] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.212815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.212882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.213181] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.213310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.213421] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4120ed87-fb96-4685-aabd-90a91df342cd is going to be updated. [ 1134.243372] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.243580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.243580] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.243816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.243954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.253774] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4120ed87-fb96-4685-aabd-90a91df342cd in Status: IN_PROGRESS for 2s [ 1134.266529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.266788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.266991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.267268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.267451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.267674] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.267783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.267873] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.268035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.268118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.268218] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be updated. [ 1134.302118] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.302324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.302324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.302590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.302773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.319240] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: IN_PROGRESS for 2s [ 1134.571096] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1134.571329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.571834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.571834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.571834] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.075064] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.075273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.075273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.075416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.075593] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.075693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.075756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.075910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.075995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.076094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.076181] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.096623] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1135.096855] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 1135.096948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.454453] env[66157]: INFO networking_nsxv3.common.synchronization [req-7cdc2bf7-55ac-4d11-b8b3-2fc09a386c96 req-2d9f7b7a-3f7b-47fb-ae46-65a426c6d364 tempest-MultipleCreateTestJSON-2091741498 tempest-MultipleCreateTestJSON-2091741498-project-member] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1135.455033] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1135.455481] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.455595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.455666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.456012] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.456183] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.456317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.456355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.456648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.456648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.456648] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.578589] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.578794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.652385] env[66157]: INFO networking_nsxv3.common.synchronization [req-b140991c-af8e-4a8c-b5c0-036452485d0e req-9d236371-dc04-4ad9-b6a2-d1784383e17b tempest-MultipleCreateTestJSON-2091741498 tempest-MultipleCreateTestJSON-2091741498-project-member] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1135.652926] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGHEST for action security_group_members [ 1135.653241] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.653410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.960542] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.263181] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4120ed87-fb96-4685-aabd-90a91df342cd in Status: SUCCESS [ 1136.263313] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4120ed87-fb96-4685-aabd-90a91df342cd deletion is rescheduled due to dependency. [ 1136.263446] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.329946] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00106a4a-ef70-4397-a8b9-afffa44e977b in Status: SUCCESS [ 1136.330285] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b deletion is rescheduled due to dependency. [ 1136.330463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.463268] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.965224] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.965484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.965565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.965783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.965884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.965986] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1136.995068] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.995239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.995318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.995581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.996026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.006433] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1139.017518] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1139.017951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.018041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.018253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.018443] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.018556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.018621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.018770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.018965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.018965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.019099] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.019176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.019234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.019371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.019506] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.019594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.019653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.019862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.019862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.019957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.019997] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.021443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.021604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.021752] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.021899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.021977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.022134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.023236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.023572] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.454901] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.455122] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.455253] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.455522] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.455779] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.455945] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.456073] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.456287] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.456429] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.456633] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1139.456744] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.456851] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.456955] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.457077] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1139.457181] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.457311] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.477411] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.477566] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1139.477701] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.477871] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-407" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.478269] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-c0254448-6efe-42cb-b178-3c95649cb256 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.478451] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.478578] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.478881] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.479069] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0254448-6efe-42cb-b178-3c95649cb256',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.524563] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16ef380f-fc6a-4b09-a172-185ed835a4be: rpc.has_security_group_logging(os_id): False [ 1139.525825] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.525958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.526068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.526280] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.526373] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.526665] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.526665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.526757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.526845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.526919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.527021] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1139.542967] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.543162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.543162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.543362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.543450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.543689] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.543783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.543845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.544026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.544126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.544683] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.544788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.544853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.545014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.545090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.545282] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.545454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.545528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.545671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.545747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.545835] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be updated. [ 1139.554515] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.554631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.554697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.554874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.555024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.568242] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1139.613988] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.614185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.614185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.614452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.614598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.629640] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: IN_PROGRESS for 2s [ 1139.981408] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.981691] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.981898] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.982228] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.982422] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.982722] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.982885] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.983044] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.983278] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.983415] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.983700] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.983856] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.983972] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.984200] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.984409] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.984563] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: c0254448-6efe-42cb-b178-3c95649cb256 is going to be updated. [ 1140.006278] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.006493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.006631] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.007038] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.007309] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.007565] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.654153] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1140.655021] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1140.689398] env[66157]: INFO networking_nsxv3.common.synchronization [req-43078655-7efc-42b1-9912-20ca93565f5b req-7caf057a-b7aa-436f-a2b6-bb585269961a service nova] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_rules [ 1140.689398] env[66157]: INFO networking_nsxv3.common.synchronization [req-43078655-7efc-42b1-9912-20ca93565f5b req-7caf057a-b7aa-436f-a2b6-bb585269961a service nova] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1140.689398] env[66157]: INFO networking_nsxv3.common.synchronization [req-43078655-7efc-42b1-9912-20ca93565f5b req-7caf057a-b7aa-436f-a2b6-bb585269961a service nova] Enqueued Resource ID: c0254448-6efe-42cb-b178-3c95649cb256 with Priority: HIGHEST for action port [ 1140.689398] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_rules [ 1140.689398] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1140.689684] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0254448-6efe-42cb-b178-3c95649cb256 with Priority: HIGHEST for action port [ 1140.690140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.690512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.690667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.690960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.691224] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.692671] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.692671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.692671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.692886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.693293] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.693293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.693293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.693293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.693482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.693482] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.694214] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0254448-6efe-42cb-b178-3c95649cb256 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.694319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.694408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.694559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.694632] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0254448-6efe-42cb-b178-3c95649cb256',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.196651] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.197750] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.197911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.198033] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0254448-6efe-42cb-b178-3c95649cb256 with status ACTIVE [ 1141.198171] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.198272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.198356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.198599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.198694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.198873] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.198998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.199107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.199198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.199271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.199453] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.199535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.199594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.199727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.199800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.199874] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0254448-6efe-42cb-b178-3c95649cb256 is going to be updated. [ 1141.220017] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.220754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.220754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.220754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.220754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.220754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0254448-6efe-42cb-b178-3c95649cb256" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.578937] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1141.579147] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be deletion is rescheduled due to dependency. [ 1141.579262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.642884] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16ef380f-fc6a-4b09-a172-185ed835a4be in Status: SUCCESS [ 1141.643139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.701704] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.206275] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.206275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.206275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.206506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.206506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.206569] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be updated. [ 1142.241519] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.241814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.241814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.241977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.242122] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.252829] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1144.267024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1144.267024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.267024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.267024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.267024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.267024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.267024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.267024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.267024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.267024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.267024] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.769593] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.769856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.769856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.770064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.770235] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.770367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.770512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.770672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.770792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.770856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.771013] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.771114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.771179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.771326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.771511] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.771600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.771600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.771742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.771814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.771895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.771987] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.274326] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a3d86b0-5e47-4031-aa77-b1a917545a8b: rpc.has_security_group_logging(os_id): False [ 1145.310696] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.310939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.311264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.311264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.311394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.311659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.311760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.311829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.312026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.312096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.312309] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.312427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.312482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.312675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.312802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.312967] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.313091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.313249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.313326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.313438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.313495] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be updated. [ 1145.409029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.409201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.409201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.409493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.409671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.424100] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1145.691106] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1145.691106] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1145.923834] env[66157]: INFO networking_nsxv3.common.synchronization [req-1dc79256-09db-4e5a-91e5-3f4f49dab97b req-e1d08342-2037-42c7-9096-8a14928f9796 tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1145.924561] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1145.924997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.925191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.925290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.925573] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.925785] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.925918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.926009] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.926213] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.926327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.926452] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.398097] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.398459] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.398561] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.398836] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.403581] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.403784] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.403921] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.404227] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.404431] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.404658] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.404775] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.404884] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.404992] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.405145] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.405269] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.405439] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.424377] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.424584] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.424726] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.424906] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.425273] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-926ea350-aa60-4aa5-9766-fa8d74ef1784 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.425486] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-926ea350-aa60-4aa5-9766-fa8d74ef1784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.425611] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-926ea350-aa60-4aa5-9766-fa8d74ef1784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.425938] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-926ea350-aa60-4aa5-9766-fa8d74ef1784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.426084] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('926ea350-aa60-4aa5-9766-fa8d74ef1784',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.429194] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.429321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.429392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.429574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.429667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.429878] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.429999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.430088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.430196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.430270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.430350] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1146.462090] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.462333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.462413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.462669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.462776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.472374] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1146.930070] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.930070] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.930070] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.930468] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.930468] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.930468] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 926ea350-aa60-4aa5-9766-fa8d74ef1784 not found, creating... [ 1146.930684] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.930865] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.930961] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.931265] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.931449] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.931766] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.932369] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.932369] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.932369] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.932539] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.932606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 926ea350-aa60-4aa5-9766-fa8d74ef1784 is going to be created. [ 1146.963316] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.963592] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.963745] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.964037] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.964423] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.964564] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-926ea350-aa60-4aa5-9766-fa8d74ef1784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.437558] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1147.437872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.705319] env[66157]: INFO networking_nsxv3.common.synchronization [req-1dc79256-09db-4e5a-91e5-3f4f49dab97b req-88e41d50-2384-40d6-b8c1-8b5ccd258d06 service nova] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 1147.705479] env[66157]: INFO networking_nsxv3.common.synchronization [req-1dc79256-09db-4e5a-91e5-3f4f49dab97b req-88e41d50-2384-40d6-b8c1-8b5ccd258d06 service nova] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1147.705631] env[66157]: INFO networking_nsxv3.common.synchronization [req-1dc79256-09db-4e5a-91e5-3f4f49dab97b req-88e41d50-2384-40d6-b8c1-8b5ccd258d06 service nova] Enqueued Resource ID: 926ea350-aa60-4aa5-9766-fa8d74ef1784 with Priority: HIGHEST for action port [ 1147.706358] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 1147.706485] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1147.706610] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 926ea350-aa60-4aa5-9766-fa8d74ef1784 with Priority: HIGHEST for action port [ 1147.706917] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.707063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.707581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.707581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.707581] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.711855] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.711855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.711855] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-926ea350-aa60-4aa5-9766-fa8d74ef1784 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.711855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-926ea350-aa60-4aa5-9766-fa8d74ef1784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.711855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-926ea350-aa60-4aa5-9766-fa8d74ef1784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.711855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-926ea350-aa60-4aa5-9766-fa8d74ef1784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.711855] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('926ea350-aa60-4aa5-9766-fa8d74ef1784',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.158378] env[66157]: INFO networking_nsxv3.common.synchronization [req-c6cc9470-f221-488c-8537-d0a2765e6de0 req-3c103b19-fe6c-4786-a071-ab037aef45b6 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1148.158986] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1148.159314] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.159447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.159514] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.159713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.159882] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.160019] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.160061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.160198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.160283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.160377] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.212738] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.212887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.213259] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 926ea350-aa60-4aa5-9766-fa8d74ef1784 with status ACTIVE [ 1148.213300] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.213427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.213567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.213782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.213871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.214290] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.214290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.214290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.214478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.214478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.214644] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.214748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.214851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.214949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.215046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.215196] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 926ea350-aa60-4aa5-9766-fa8d74ef1784 is going to be updated. [ 1148.243677] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.243811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.243849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.244302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.244302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.244442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-926ea350-aa60-4aa5-9766-fa8d74ef1784" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.484305] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1148.484672] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 deletion is rescheduled due to dependency. [ 1148.484791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.484976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.485279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.485623] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.485839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.485926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.486136] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.486221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.486379] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.559641] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.559850] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.560253] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.560516] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.560815] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.560981] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.561118] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.561345] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.561493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.561733] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.561861] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.561972] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.562094] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.562237] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.562351] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.562481] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.583574] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.583756] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.583900] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.584099] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.584578] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-2ef59692-bd25-4b2d-bf99-6503d70063d9 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.584761] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-2ef59692-bd25-4b2d-bf99-6503d70063d9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.584882] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-2ef59692-bd25-4b2d-bf99-6503d70063d9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.585220] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-2ef59692-bd25-4b2d-bf99-6503d70063d9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.585386] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef59692-bd25-4b2d-bf99-6503d70063d9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.663514] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.663640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.663719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.663975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.690517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.690818] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.691045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.691045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.691708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.691708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.691708] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1148.724724] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.724724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.724724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.725062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.725062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.738160] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1148.988850] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.088235] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.088529] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.088697] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.089026] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.089237] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.089402] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 2ef59692-bd25-4b2d-bf99-6503d70063d9 not found, creating... [ 1149.089718] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.089893] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.090025] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.090251] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.090388] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.090708] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.090888] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.091043] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.091275] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.091433] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.091580] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 2ef59692-bd25-4b2d-bf99-6503d70063d9 is going to be created. [ 1149.115666] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.115957] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.116028] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.116316] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.116822] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.116822] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-2ef59692-bd25-4b2d-bf99-6503d70063d9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.493280] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.839287] env[66157]: INFO networking_nsxv3.common.synchronization [req-c6cc9470-f221-488c-8537-d0a2765e6de0 req-793636fd-4bd0-42d4-9082-45d1ae497dd5 service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1149.839287] env[66157]: INFO networking_nsxv3.common.synchronization [req-c6cc9470-f221-488c-8537-d0a2765e6de0 req-793636fd-4bd0-42d4-9082-45d1ae497dd5 service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1149.839483] env[66157]: INFO networking_nsxv3.common.synchronization [req-c6cc9470-f221-488c-8537-d0a2765e6de0 req-793636fd-4bd0-42d4-9082-45d1ae497dd5 service nova] Enqueued Resource ID: 2ef59692-bd25-4b2d-bf99-6503d70063d9 with Priority: HIGHEST for action port [ 1149.839866] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1149.840120] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1149.840268] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef59692-bd25-4b2d-bf99-6503d70063d9 with Priority: HIGHEST for action port [ 1149.840554] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.840680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.840752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.840949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.841078] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.842290] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.843032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.843032] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ef59692-bd25-4b2d-bf99-6503d70063d9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.843032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ef59692-bd25-4b2d-bf99-6503d70063d9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.843032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ef59692-bd25-4b2d-bf99-6503d70063d9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.843032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ef59692-bd25-4b2d-bf99-6503d70063d9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.843303] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef59692-bd25-4b2d-bf99-6503d70063d9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.995908] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.997205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.997205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.997205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.997205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.997205] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1150.027877] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.028102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.028152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.028418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.028599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.041450] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1150.343575] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.343821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.346446] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ef59692-bd25-4b2d-bf99-6503d70063d9 with status ACTIVE [ 1150.346690] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.346829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.346907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.347176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.347276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.347457] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.347609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.347609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.347767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.347878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.348090] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.348190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.348254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.348396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.348597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.348701] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ef59692-bd25-4b2d-bf99-6503d70063d9 is going to be updated. [ 1150.380519] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.380720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.380720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.380940] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.381106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.381313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ef59692-bd25-4b2d-bf99-6503d70063d9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.750848] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1150.750848] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e deletion is rescheduled due to dependency. [ 1150.750848] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.751286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.751286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.751507] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.751640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.751704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.751882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.751966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.752072] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.255311] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.753202] env[66157]: INFO networking_nsxv3.common.synchronization [req-2a0c9e01-8275-4a0e-b974-854a82111f41 req-597d32cf-27f8-4122-918f-c95bfd7e2a45 tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1151.754157] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1151.754755] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.754888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.754981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.755166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.755366] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.755471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.755542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.755691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.755781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.755876] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.760024] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.055813] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1152.055986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.056163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.056400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.056623] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.056737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.056798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.056986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.057164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.057164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.057300] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.187875] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.188188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.188346] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.188646] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.189015] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.189137] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.189259] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.189532] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.189702] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.189959] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.190114] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.190233] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.191014] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.191014] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.191014] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.191205] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.218805] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.218969] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.219178] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.219392] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.219752] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-d30cccf8-5c51-4d93-9f11-481ee2f886d6 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.220159] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-d30cccf8-5c51-4d93-9f11-481ee2f886d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.220394] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-d30cccf8-5c51-4d93-9f11-481ee2f886d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.221866] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-d30cccf8-5c51-4d93-9f11-481ee2f886d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.221866] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d30cccf8-5c51-4d93-9f11-481ee2f886d6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.263181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.263389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.263434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.263667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.263761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.263860] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1152.265269] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.265408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.265408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.265587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.265669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.265844] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.265955] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.266030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.266179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.266255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.266340] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1152.299895] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.300105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.300151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.300371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.300533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.302659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.302809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.302879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.303094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.303243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.315573] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1152.316420] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1152.560949] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.724849] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.725209] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.725209] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.725464] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.725635] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.726177] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port d30cccf8-5c51-4d93-9f11-481ee2f886d6 not found, creating... [ 1152.726369] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.726633] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.726762] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.727701] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.727701] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.727838] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.727925] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.728062] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.728315] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.728455] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.728664] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: d30cccf8-5c51-4d93-9f11-481ee2f886d6 is going to be created. [ 1152.762117] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.762438] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.762575] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.762995] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.763240] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.763490] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-d30cccf8-5c51-4d93-9f11-481ee2f886d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.062891] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2381db7b-1b29-4dfc-a6af-48c498e3e0b0: rpc.has_security_group_logging(os_id): False [ 1153.081030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.081030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.081030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.081263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.081263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.081453] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.081588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.081698] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.081783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.081862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.081973] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1153.147254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.147406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.147475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.147679] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.147820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.162921] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1153.490712] env[66157]: INFO networking_nsxv3.common.synchronization [req-2a0c9e01-8275-4a0e-b974-854a82111f41 req-6bc783a0-ea09-4c98-9b74-1f5d2731f5b6 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 1153.490828] env[66157]: INFO networking_nsxv3.common.synchronization [req-2a0c9e01-8275-4a0e-b974-854a82111f41 req-6bc783a0-ea09-4c98-9b74-1f5d2731f5b6 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1153.490967] env[66157]: INFO networking_nsxv3.common.synchronization [req-2a0c9e01-8275-4a0e-b974-854a82111f41 req-6bc783a0-ea09-4c98-9b74-1f5d2731f5b6 service nova] Enqueued Resource ID: d30cccf8-5c51-4d93-9f11-481ee2f886d6 with Priority: HIGHEST for action port [ 1153.491507] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 1153.491645] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1153.491745] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30cccf8-5c51-4d93-9f11-481ee2f886d6 with Priority: HIGHEST for action port [ 1153.492035] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.492156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.492268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.492420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.492505] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.495075] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.495162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.495411] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d30cccf8-5c51-4d93-9f11-481ee2f886d6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.496044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d30cccf8-5c51-4d93-9f11-481ee2f886d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.496044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d30cccf8-5c51-4d93-9f11-481ee2f886d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.496044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d30cccf8-5c51-4d93-9f11-481ee2f886d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.496044] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d30cccf8-5c51-4d93-9f11-481ee2f886d6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.997485] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.997899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.997899] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d30cccf8-5c51-4d93-9f11-481ee2f886d6 with status ACTIVE [ 1153.998160] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.998305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.998395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.998662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.998780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.999013] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.999141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.999285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.999407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.999506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.999743] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.999866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.999948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.000137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.000237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.000353] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d30cccf8-5c51-4d93-9f11-481ee2f886d6 is going to be updated. [ 1154.022706] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.022875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.022978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.023215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.023383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.023566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d30cccf8-5c51-4d93-9f11-481ee2f886d6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.328365] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1154.328620] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 1154.328751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.328921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.329209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.329481] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.329703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.329811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.330085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.330217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.330357] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.332158] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1154.332391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.334362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.334581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.334767] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.334885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.334984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.335149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.335239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.335333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.335426] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.839172] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.839256] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.839350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.839656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.839824] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.839908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.840056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.840222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.840312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.840402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.840549] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.840641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.840701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.840839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.840967] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.841068] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.841126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.841262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.841448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.841448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.841515] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.842837] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.085416] env[66157]: INFO networking_nsxv3.common.synchronization [req-c0cfb208-885e-4751-927f-0c74ff812335 req-1189ceb3-6b76-48b4-9d28-efed82b151af tempest-ListServerFiltersTestJSON-1619138676 tempest-ListServerFiltersTestJSON-1619138676-project-member] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1155.085994] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1155.086599] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.086599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.086599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.086835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.086917] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.087826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.087826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.089215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.089320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.089376] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.176347] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1155.176680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.347486] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fec754f5-f737-48ef-9255-9d4bc7df0c2e: rpc.has_security_group_logging(os_id): False [ 1155.348914] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.379561] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.381051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.381051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.381051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.381051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.381051] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.381051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.381700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.382806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.382806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.383191] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.383396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.383535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.383906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.384143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.384507] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.384615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.384686] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.384949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.385114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.385197] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1155.477038] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.477038] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.477038] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.477038] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.477361] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.477361] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.477588] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.477804] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.477975] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.478279] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.478462] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.478613] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.478739] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.478876] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.479022] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.479256] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.485499] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.485718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.485718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.486017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.486110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.499715] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1155.513653] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.513907] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.514100] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.514383] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.515250] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.515250] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.515512] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.516532] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.516532] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5fa0ac9-4de0-4dae-a5a7-672627f84b86',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.594468] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.594468] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.594468] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 already deleted. [ 1155.594468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.801785] env[66157]: INFO networking_nsxv3.common.synchronization [None req-04d70946-4e97-4b9a-8b7c-9f6788462c55 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1155.802544] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1155.803296] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.803296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.803459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.803622] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.805362] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.805362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.805362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.805362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.805362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.805362] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.851997] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.852440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.852522] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.853219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.853219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.853219] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1155.895024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.895024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.895222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.895414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.895611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.906955] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1156.019055] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.019336] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.019467] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.019888] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.020107] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.020304] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port b5fa0ac9-4de0-4dae-a5a7-672627f84b86 not found, creating... [ 1156.020602] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.020824] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.020959] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.021232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.021380] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.021686] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.021843] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.021958] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.022607] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.022751] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.022897] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: b5fa0ac9-4de0-4dae-a5a7-672627f84b86 is going to be created. [ 1156.047704] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.048392] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.048508] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.048785] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.049040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.049290] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.307538] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.772992] env[66157]: INFO networking_nsxv3.common.synchronization [req-c0cfb208-885e-4751-927f-0c74ff812335 req-af22747d-0e5e-4824-9377-f9c0d6e7c248 service nova] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_rules [ 1156.773189] env[66157]: INFO networking_nsxv3.common.synchronization [req-c0cfb208-885e-4751-927f-0c74ff812335 req-af22747d-0e5e-4824-9377-f9c0d6e7c248 service nova] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1156.773332] env[66157]: INFO networking_nsxv3.common.synchronization [req-c0cfb208-885e-4751-927f-0c74ff812335 req-af22747d-0e5e-4824-9377-f9c0d6e7c248 service nova] Enqueued Resource ID: b5fa0ac9-4de0-4dae-a5a7-672627f84b86 with Priority: HIGHEST for action port [ 1156.773877] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_rules [ 1156.774152] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1156.774152] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fa0ac9-4de0-4dae-a5a7-672627f84b86 with Priority: HIGHEST for action port [ 1156.774425] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.774592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.774674] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.774852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.774933] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.777033] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.777033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.777033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.777033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.777349] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.777349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.777349] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.777458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.777497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.777635] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.778405] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.778573] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.778727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.778890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.778970] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5fa0ac9-4de0-4dae-a5a7-672627f84b86',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.810909] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.280966] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.281744] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.281887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.282059] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5fa0ac9-4de0-4dae-a5a7-672627f84b86 with status ACTIVE [ 1157.282307] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.282408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.282802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.282802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.283029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.283029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.283163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.283211] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.283381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.283381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.283572] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.283665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.283725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.283856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.283921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.284195] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5fa0ac9-4de0-4dae-a5a7-672627f84b86 is going to be updated. [ 1157.313646] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.314016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.314016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.314331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.314433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.314532] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1157.316648] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.316797] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.316855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.317463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.317612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.317796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5fa0ac9-4de0-4dae-a5a7-672627f84b86" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.378288] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.378288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.378288] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.378568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.378568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.400150] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1157.521880] env[66157]: INFO networking_nsxv3.common.synchronization [req-cc235179-94a6-48f0-a818-db4f544f5d33 req-98a73979-c6e9-443b-a254-8ecee9fbaab9 tempest-ListServerFiltersTestJSON-1619138676 tempest-ListServerFiltersTestJSON-1619138676-project-member] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1157.523152] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1157.523365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.523971] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1157.524398] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.524557] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.786209] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.915078] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.915503] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.915503] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.915709] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.915971] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.916308] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.916519] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.916825] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.917066] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.917364] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.917548] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.917706] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.917858] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.918029] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.918190] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.918385] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.921505] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1157.921505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.921505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.921505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.921505] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.921505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.921505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.921800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.922895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.922895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.922895] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.947774] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.948051] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1157.948308] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.948864] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.949389] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-bb5b6f74-c3e2-44ab-b372-6be962126244 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.949632] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-bb5b6f74-c3e2-44ab-b372-6be962126244" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.949789] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-bb5b6f74-c3e2-44ab-b372-6be962126244" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.950149] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-bb5b6f74-c3e2-44ab-b372-6be962126244" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.950326] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb5b6f74-c3e2-44ab-b372-6be962126244',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.292144] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.292144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.292144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.292144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.292144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.292144] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be created. [ 1158.329983] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.330525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.330525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.330525] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.330675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.345082] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: UNINITIALIZED for 2s [ 1158.424929] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.425240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.425240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.425499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.425682] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.425792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.425877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.426052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.426144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.426242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.426388] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.426484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.426546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.426708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.426854] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.426947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.427025] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.427159] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.427239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.427320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.427408] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.452371] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.452613] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.452923] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.453242] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.453431] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.453618] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port bb5b6f74-c3e2-44ab-b372-6be962126244 not found, creating... [ 1158.453915] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.454183] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.454337] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.454601] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.454852] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.455196] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.455444] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.455639] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.455904] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.456087] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.456264] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: bb5b6f74-c3e2-44ab-b372-6be962126244 is going to be created. [ 1158.477241] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.477497] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.477600] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.478018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.478107] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.478339] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-bb5b6f74-c3e2-44ab-b372-6be962126244" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.876842] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.877058] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.877186] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.877451] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.877751] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.877931] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.878229] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.878459] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.878606] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.878811] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.878922] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.879044] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.879152] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.879262] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.879366] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.879493] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.898715] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.898896] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1158.899046] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.899229] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.899547] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-8ead78e3-ec2c-4af5-87fe-f227f94bacab taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.899729] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-8ead78e3-ec2c-4af5-87fe-f227f94bacab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.899848] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-8ead78e3-ec2c-4af5-87fe-f227f94bacab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.900269] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-8ead78e3-ec2c-4af5-87fe-f227f94bacab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.900414] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ead78e3-ec2c-4af5-87fe-f227f94bacab',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.930152] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94: rpc.has_security_group_logging(os_id): False [ 1158.951479] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.951785] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.951917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.952144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.952302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.952491] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.952605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.952699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.952822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.952896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.953117] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.953226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.953286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.953407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.953482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.953650] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.953748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.953801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.953924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.953994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.954091] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1159.020953] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.021236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.021236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.021438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.021559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.033789] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1159.187328] env[66157]: INFO networking_nsxv3.common.synchronization [req-cc235179-94a6-48f0-a818-db4f544f5d33 req-71af9147-603d-40f6-aedd-cc75c43e71a8 service nova] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_rules [ 1159.187443] env[66157]: INFO networking_nsxv3.common.synchronization [req-cc235179-94a6-48f0-a818-db4f544f5d33 req-71af9147-603d-40f6-aedd-cc75c43e71a8 service nova] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1159.187581] env[66157]: INFO networking_nsxv3.common.synchronization [req-cc235179-94a6-48f0-a818-db4f544f5d33 req-71af9147-603d-40f6-aedd-cc75c43e71a8 service nova] Enqueued Resource ID: bb5b6f74-c3e2-44ab-b372-6be962126244 with Priority: HIGHEST for action port [ 1159.188135] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_rules [ 1159.188282] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1159.188383] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5b6f74-c3e2-44ab-b372-6be962126244 with Priority: HIGHEST for action port [ 1159.188656] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.188765] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.188967] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.189189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.189429] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb5b6f74-c3e2-44ab-b372-6be962126244 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.189569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb5b6f74-c3e2-44ab-b372-6be962126244" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.189662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb5b6f74-c3e2-44ab-b372-6be962126244" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.189895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb5b6f74-c3e2-44ab-b372-6be962126244" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.190133] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb5b6f74-c3e2-44ab-b372-6be962126244',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.404174] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.404545] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.404545] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.404808] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.404957] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.405294] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 8ead78e3-ec2c-4af5-87fe-f227f94bacab not found, creating... [ 1159.405511] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.405688] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.405809] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.406045] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.406193] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.406999] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.407177] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.407299] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.407515] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.407652] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.407793] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 8ead78e3-ec2c-4af5-87fe-f227f94bacab is going to be created. [ 1159.414579] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1159.414807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.430977] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.431211] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.431337] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.431612] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.431848] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.432114] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-8ead78e3-ec2c-4af5-87fe-f227f94bacab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.694525] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb5b6f74-c3e2-44ab-b372-6be962126244 with status ACTIVE [ 1159.694759] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.694904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.694973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.695270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.695387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.695576] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.695678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.695742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.695895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.695972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.696169] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.696262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.696323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.696510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.696599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.696688] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb5b6f74-c3e2-44ab-b372-6be962126244 is going to be updated. [ 1159.717476] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.717626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.717693] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.717904] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.718047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.718219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb5b6f74-c3e2-44ab-b372-6be962126244" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.772476] env[66157]: INFO networking_nsxv3.common.synchronization [req-b1f5edf9-190c-4f03-b066-58728cd35d5e req-00dacdf7-64a8-4129-8ad7-72bf3f171c62 tempest-ListServerFiltersTestJSON-1619138676 tempest-ListServerFiltersTestJSON-1619138676-project-member] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1159.773402] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1159.773840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.773964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.091404] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.091595] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.091720] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.091985] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.092289] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.092623] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.092841] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.093084] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.093253] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.093470] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1160.093584] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.093705] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.093810] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.093920] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1160.094039] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.094212] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.114416] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.114874] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1160.115174] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.115418] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-87" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.115885] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-d8d85f6b-dfcf-4475-b67d-cbb320774257 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.116112] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-d8d85f6b-dfcf-4475-b67d-cbb320774257" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.116259] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-d8d85f6b-dfcf-4475-b67d-cbb320774257" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.116587] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-d8d85f6b-dfcf-4475-b67d-cbb320774257" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.116740] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8d85f6b-dfcf-4475-b67d-cbb320774257',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.132232] env[66157]: INFO networking_nsxv3.common.synchronization [req-eff23ea8-eeff-45fc-a05f-165f3eca0e03 req-d2dd4d05-105e-4d27-840d-4f574595974b service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1160.132430] env[66157]: INFO networking_nsxv3.common.synchronization [req-eff23ea8-eeff-45fc-a05f-165f3eca0e03 req-d2dd4d05-105e-4d27-840d-4f574595974b service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1160.132575] env[66157]: INFO networking_nsxv3.common.synchronization [req-eff23ea8-eeff-45fc-a05f-165f3eca0e03 req-d2dd4d05-105e-4d27-840d-4f574595974b service nova] Enqueued Resource ID: 8ead78e3-ec2c-4af5-87fe-f227f94bacab with Priority: HIGHEST for action port [ 1160.133113] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1160.133289] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1160.133589] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ead78e3-ec2c-4af5-87fe-f227f94bacab with Priority: HIGHEST for action port [ 1160.133724] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.133921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.133971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.135502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.135502] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.136766] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.138651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.138651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.138651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.138651] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.138651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.138651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.138651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.138651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.138651] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.138651] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ead78e3-ec2c-4af5-87fe-f227f94bacab taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.139268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ead78e3-ec2c-4af5-87fe-f227f94bacab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.139268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ead78e3-ec2c-4af5-87fe-f227f94bacab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.139268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ead78e3-ec2c-4af5-87fe-f227f94bacab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.139268] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ead78e3-ec2c-4af5-87fe-f227f94bacab',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.356910] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1160.357329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.358963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.359425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.359671] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.359801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.359871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.360166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.360312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.360385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.360452] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.361375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.361629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.361919] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.362096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.362164] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.362424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.363360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.363360] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.619212] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.619612] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.619612] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.619774] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.619945] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.620091] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port d8d85f6b-dfcf-4475-b67d-cbb320774257 not found, creating... [ 1160.620419] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.620624] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.620675] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.620900] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.621032] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.621366] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.621549] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.621666] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.621879] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.622012] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.622273] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: d8d85f6b-dfcf-4475-b67d-cbb320774257 is going to be created. [ 1160.637084] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.637255] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.641073] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ead78e3-ec2c-4af5-87fe-f227f94bacab with status ACTIVE [ 1160.641345] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.642033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.642033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.642033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.642033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.642033] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.642270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.642270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.642378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.642421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.642617] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.642712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.642764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.642899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.642971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.643068] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ead78e3-ec2c-4af5-87fe-f227f94bacab is going to be updated. [ 1160.644202] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.645898] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.646186] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.646335] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.646553] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.646887] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.647377] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-d8d85f6b-dfcf-4475-b67d-cbb320774257" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.669405] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.669684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.669806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.670117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.670283] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.670455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ead78e3-ec2c-4af5-87fe-f227f94bacab" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.866181] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.866414] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.866548] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.050477] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1161.050794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.148925] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.369206] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.393790] env[66157]: INFO networking_nsxv3.common.synchronization [req-b1f5edf9-190c-4f03-b066-58728cd35d5e req-bba989ec-44dd-4d86-b71c-414167e6346f service nova] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_rules [ 1161.393980] env[66157]: INFO networking_nsxv3.common.synchronization [req-b1f5edf9-190c-4f03-b066-58728cd35d5e req-bba989ec-44dd-4d86-b71c-414167e6346f service nova] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1161.394162] env[66157]: INFO networking_nsxv3.common.synchronization [req-b1f5edf9-190c-4f03-b066-58728cd35d5e req-bba989ec-44dd-4d86-b71c-414167e6346f service nova] Enqueued Resource ID: d8d85f6b-dfcf-4475-b67d-cbb320774257 with Priority: HIGHEST for action port [ 1161.394842] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_rules [ 1161.394987] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1161.396580] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8d85f6b-dfcf-4475-b67d-cbb320774257 with Priority: HIGHEST for action port [ 1161.398109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.398109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.398109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.398109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.398354] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8d85f6b-dfcf-4475-b67d-cbb320774257 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.398909] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8d85f6b-dfcf-4475-b67d-cbb320774257" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.400798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8d85f6b-dfcf-4475-b67d-cbb320774257" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.401163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8d85f6b-dfcf-4475-b67d-cbb320774257" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.401163] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8d85f6b-dfcf-4475-b67d-cbb320774257',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.652402] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.652402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.652402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.652402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.652402] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.652402] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1161.686626] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.686855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.686932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.687156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.687472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.708548] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1161.872149] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.872363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.872462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.872748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.872878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.873057] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1161.904725] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8d85f6b-dfcf-4475-b67d-cbb320774257 with status ACTIVE [ 1161.905021] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.905264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.905350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.905607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.905683] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.905946] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.906127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.906261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.906295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.906381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.906577] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.906663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.906791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.906943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.907078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.907146] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8d85f6b-dfcf-4475-b67d-cbb320774257 is going to be updated. [ 1161.908972] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.909457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.909457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.909457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.909457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.925575] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1161.948490] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.948689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.948689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.948877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.949035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.949205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8d85f6b-dfcf-4475-b67d-cbb320774257" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.719330] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1163.719780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.719780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.720033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.720245] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.720383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.720469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.720672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.720759] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.720844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.720970] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.937714] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1163.937913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.938123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.938340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.939751] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.939751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.939751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.939751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.939751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.939751] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.224090] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.224090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.224443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.224638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.224831] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.224943] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.225015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.225216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.225307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.225400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.225581] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.225677] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.225752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.225896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.226068] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.226180] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.226237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.226404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.226516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.226605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.226714] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.442466] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.729790] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fec754f5-f737-48ef-9255-9d4bc7df0c2e: rpc.has_security_group_logging(os_id): False [ 1164.753041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.753209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.753287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.753516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.753603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.753830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.753959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.754023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.754169] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.754271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.754453] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.754608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.754608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.754737] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.754828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.755015] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.755266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.755305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.755442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.755518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.755600] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1164.825163] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.825432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.825487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.825811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.826085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.840321] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1164.945450] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.448213] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.448447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.448447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.448655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.448751] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.449397] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1165.483128] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.483332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.483332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.483833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.483833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.493497] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1166.397593] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1166.397940] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 1166.854557] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1166.854774] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.504180] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1167.504527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.504687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.504951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.505223] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.505391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.505459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.505635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.505722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.505829] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.009088] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.491148] env[66157]: INFO networking_nsxv3.common.synchronization [req-7622bdc8-5961-4941-b6f8-366c30418bed req-74582a51-19bb-4c5a-8b24-af95eb9f379c tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1168.491818] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1168.492369] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.492577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.492690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.493236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.493236] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.493339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.493404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.493609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.493664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.493774] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.512134] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.997451] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.997638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.997638] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.997830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.997927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.998143] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.998257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.998318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.998447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.998691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.998691] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1169.016085] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.016085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.016085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.016085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.016085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.016085] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1169.043041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.043041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.043041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.043041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.043041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.045338] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.045516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.045615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.045820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.045982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.058053] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1169.059127] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1171.072536] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1171.072858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.073101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.073957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.074314] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.074507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.074507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.074754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.074862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.074967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.075408] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.075505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.075548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.075733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.075908] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.076071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.076358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.076569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.076655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.076765] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.077446] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.078506] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1171.078729] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 1171.078869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.079247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.079502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.079731] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.079908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.080018] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.080261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.080405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.080572] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.582413] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1b6b4a-f6fc-4455-852a-7c4e38106c56: rpc.has_security_group_logging(os_id): False [ 1171.583707] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.606562] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.606676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.606764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.606982] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.607089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.607340] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.607443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.607502] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.607650] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.607727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.607907] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.608010] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.608075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.608243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.608319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.608524] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.608615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.608678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.609265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.609265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.609265] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be created. [ 1171.684816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.684816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.684816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.684816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.684816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.695594] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1172.086843] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.590679] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.590842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.590908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.591167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.591264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.591365] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1172.693108] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.693323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.695174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.695467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.695629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.707111] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1172.949889] env[66157]: INFO networking_nsxv3.common.synchronization [req-9c7b3b0f-b3fa-40df-9ff3-3cd7b142324a req-e3379b8c-50ab-469d-b9d1-9f8f56481c5e tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1172.952031] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1172.952146] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.952295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.952326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.952590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.952685] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.952769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.952869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.952969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.953076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.953211] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.455273] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.711067] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1173.711472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.711853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.711976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.712160] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.749907] env[66157]: INFO networking_nsxv3.common.synchronization [None req-2e4f95d6-ca40-47a0-a39a-0f5abd41fa43 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1173.749907] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1173.749907] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.749907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.958125] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.215461] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.215461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.460283] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.460702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.460702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.460833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.460941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.461097] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1174.491520] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.491732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.491791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.492128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.492324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.504775] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1174.893215] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1174.893413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.893413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.893635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.893851] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.893963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.894037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.894381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.894474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.894611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.894718] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.078872] env[66157]: INFO networking_nsxv3.common.synchronization [req-4d94181f-8bdd-48d1-8922-0d6d4c5edc53 req-50b169dd-b3cb-410e-aa30-b9bffca5f055 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_members [ 1175.078872] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGHEST for action security_group_members [ 1175.079209] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.079209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.079819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.079819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.079819] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.079819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.080192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.080192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.080192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.080192] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.397394] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.397727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.397727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.397829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.398014] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.398113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.398185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.398333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.398419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.398506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.398647] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.398734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.398789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.398921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.399089] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.399219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.399219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.399342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.399415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.399493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.399577] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.582995] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.583438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.583438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.583534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.611296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.611696] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.612061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.612191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.612664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.613111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.613111] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 is going to be updated. [ 1175.643345] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.643539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.643539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.643700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.643839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.654119] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 in Status: IN_PROGRESS for 2s [ 1175.902292] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1b6b4a-f6fc-4455-852a-7c4e38106c56: rpc.has_security_group_logging(os_id): False [ 1175.927310] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.927682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.927817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.928346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.928346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.928734] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.928913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.929142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.929251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.929389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.929728] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.929869] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.929971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.930132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.930274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.930591] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.930757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.931227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.931770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.931903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.932065] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1176.053172] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.053438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.053517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.053729] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.053915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.075434] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1176.189847] env[66157]: INFO networking_nsxv3.common.synchronization [req-959672cc-ab41-4201-8d70-1023a6dc658b req-7e391b9a-bae4-43e6-85f8-fed4eba11556 tempest-AttachVolumeNegativeTest-765022996 tempest-AttachVolumeNegativeTest-765022996-project-member] Enqueued Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_members [ 1176.190488] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 with Priority: HIGHEST for action security_group_members [ 1176.190928] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dae1e84-05f3-49da-b3a4-8d3f4e788988 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.191053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.191124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.191369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.191517] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.191609] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.191690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.191782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.191885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.192017] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dae1e84-05f3-49da-b3a4-8d3f4e788988',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.519427] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1176.519427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.519761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.519761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.519969] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.520104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.520173] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.520395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.520471] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.520528] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.659051] env[66157]: INFO networking_nsxv3.common.synchronization [req-7f1505e3-8494-4ddb-8781-71a44f20640d req-ca7b82f0-fd60-40c9-a94a-d3ad9a0928ca tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_members [ 1176.659900] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGHEST for action security_group_members [ 1176.660466] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe07656-65ae-471b-953b-0e7810aed7b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.660596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.660651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.660880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.661011] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.661141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.661222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.661400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.661400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.661511] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.695255] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.695464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.695464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.695682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.695775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.695980] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.696089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.696152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.696360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.696450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.696549] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 is going to be updated. [ 1176.726014] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.726203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.726247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.726554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.726746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.739935] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 in Status: IN_PROGRESS for 2s [ 1177.022868] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.023092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.023182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.023459] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.023578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.023840] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.023980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.024179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.024425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.024518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.024652] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1177.056875] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.057152] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.057315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.057519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.057672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.069085] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1177.163986] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.164276] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.164403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.164718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.168061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.168061] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.168061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.168061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.168061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.168061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.168061] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe07656-65ae-471b-953b-0e7810aed7b9 is going to be updated. [ 1177.210221] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.210221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.210326] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.210469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.210591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.220417] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe07656-65ae-471b-953b-0e7810aed7b9 in Status: IN_PROGRESS for 2s [ 1177.665670] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 in Status: SUCCESS [ 1177.666056] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 deletion is rescheduled due to dependency. [ 1177.666056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.873644] env[66157]: INFO networking_nsxv3.common.synchronization [req-2bbc55e7-38b3-41ac-b9b3-ce3dd3baa44a req-22e041b8-9537-498a-87ac-f68969f196e7 tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1177.874408] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1177.874579] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.874687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.874753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.875285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.875285] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.875285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.875285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.875489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.875489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.875564] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.099472] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1178.099665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.099823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.100064] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.100245] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.276692] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.276967] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.277150] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.277672] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.277834] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.278044] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.278212] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.278487] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.278704] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.278947] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.279119] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.279257] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.279389] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.279511] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.279614] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.279745] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.301028] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.301028] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.301209] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.301509] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-26" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.301570] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.301748] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.301966] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.302311] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.302449] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4f73cee-921a-4ac6-a1bd-2417220eaa4e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.378070] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.378279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.378394] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.378581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.378744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.378894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.378998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.379082] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.379228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.379366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.379421] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1178.405586] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.405782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.405891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.406177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.406370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.416697] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1178.603140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.603140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.603140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.603140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.603140] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.603140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.603420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.603420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.603420] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.603499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.603605] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.749128] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 in Status: SUCCESS [ 1178.749450] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dae1e84-05f3-49da-b3a4-8d3f4e788988 deletion is rescheduled due to dependency. [ 1178.749450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dae1e84-05f3-49da-b3a4-8d3f4e788988" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.805017] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.805284] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.805412] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.805738] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.805901] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.806273] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port a4f73cee-921a-4ac6-a1bd-2417220eaa4e not found, creating... [ 1178.806413] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.806570] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.806693] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.806929] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.807108] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.807419] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.807592] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.807713] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.807947] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.808122] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.808282] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: a4f73cee-921a-4ac6-a1bd-2417220eaa4e is going to be created. [ 1178.828374] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.828595] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.828721] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.828996] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.829288] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.829522] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.078686] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1179.078835] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e deletion is rescheduled due to dependency. [ 1179.078926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.107655] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.107655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.107655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.107804] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.107834] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.107924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.107979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.108132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.108238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.108357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.108543] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.108659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.108735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.109820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.109820] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.109820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.109820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.109820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.109820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.109820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.109820] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.111422] env[66157]: INFO networking_nsxv3.common.synchronization [req-192d4d0a-0deb-4ed0-8cc4-b18f3f16bc4c req-51ec9047-dafe-4a40-9b76-17132c685e42 tempest-ServersNegativeTestJSON-423798559 tempest-ServersNegativeTestJSON-423798559-project-member] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1179.112735] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGHEST for action security_group_members [ 1179.112735] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.112735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.112735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.112735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.113259] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.113259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.113259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.113259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.113259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.113259] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.230429] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe07656-65ae-471b-953b-0e7810aed7b9 in Status: SUCCESS [ 1179.230598] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe07656-65ae-471b-953b-0e7810aed7b9 deletion is rescheduled due to dependency. [ 1179.230709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.524624] env[66157]: INFO networking_nsxv3.common.synchronization [req-2bbc55e7-38b3-41ac-b9b3-ce3dd3baa44a req-6b28b517-18ec-4eb4-817a-f455d09a6992 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 1179.524624] env[66157]: INFO networking_nsxv3.common.synchronization [req-2bbc55e7-38b3-41ac-b9b3-ce3dd3baa44a req-6b28b517-18ec-4eb4-817a-f455d09a6992 service nova] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1179.524844] env[66157]: INFO networking_nsxv3.common.synchronization [req-2bbc55e7-38b3-41ac-b9b3-ce3dd3baa44a req-6b28b517-18ec-4eb4-817a-f455d09a6992 service nova] Enqueued Resource ID: a4f73cee-921a-4ac6-a1bd-2417220eaa4e with Priority: HIGHEST for action port [ 1179.525333] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_rules [ 1179.525499] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1179.525559] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f73cee-921a-4ac6-a1bd-2417220eaa4e with Priority: HIGHEST for action port [ 1179.525848] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.525993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.526077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.526291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.526371] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.527841] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.527841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.527841] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.527841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.527841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.528151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.528151] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4f73cee-921a-4ac6-a1bd-2417220eaa4e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.612574] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1b6b4a-f6fc-4455-852a-7c4e38106c56: rpc.has_security_group_logging(os_id): False [ 1179.616087] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.616087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.616087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.616087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.616087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.616393] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.616393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.616393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.616611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.616707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.616866] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be updated. [ 1179.630620] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.630620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.630862] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.630934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.631620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.631620] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.631620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.631789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.632141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.632258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.632836] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.632836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.632836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.633020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.633020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.633225] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.633578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.633578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.633721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.633841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.633973] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1179.644999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.645224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.646512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.646512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.646512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.654648] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: IN_PROGRESS for 2s [ 1179.702360] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.702524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.702586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.702787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.702936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.716225] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1180.029523] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.029924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.029924] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4f73cee-921a-4ac6-a1bd-2417220eaa4e with status ACTIVE [ 1180.030309] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.030450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.030523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.030753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.030845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.031053] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.031161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.031226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.031432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.031519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.031816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.032083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.032158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.032322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.032403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.032520] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4f73cee-921a-4ac6-a1bd-2417220eaa4e is going to be updated. [ 1180.054166] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.054375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.054375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.054602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.054740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.054905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4f73cee-921a-4ac6-a1bd-2417220eaa4e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.429300] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1180.429300] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 1180.429300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.429518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.429621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.429803] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.429998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.429998] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.430226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.430505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.430505] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.934927] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.437035] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.666528] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b in Status: SUCCESS [ 1181.666704] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b deletion is rescheduled due to dependency. [ 1181.666812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.731108] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1181.731401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.940294] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.940552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.940704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.941393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.941393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.941393] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1181.978218] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.978218] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.978436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.978699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.978886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.992713] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1183.638206] env[66157]: INFO networking_nsxv3.common.synchronization [None req-702445df-df63-4921-841d-73501b95efdc tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_rules [ 1183.638966] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_rules [ 1183.639796] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.639796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.639796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.639796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.639796] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.725848] env[66157]: INFO networking_nsxv3.common.synchronization [None req-0939f0f7-9d5e-4e3e-a127-a3247c738d6b tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_rules [ 1183.726438] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_rules [ 1183.726774] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.726941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.004895] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1184.005146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.005764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.005764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.005879] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.005984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.006083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.006279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.006578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.006722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.006820] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.165722] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.165898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.165996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.166281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.166412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.166513] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46786056-6b70-4ba1-a412-a7042077532f already deleted. [ 1184.166602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.166780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.166974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.167108] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.509621] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.509878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.509958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.510287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.510368] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.510445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.510509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.510669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.510782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.510875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.511029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.511175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.511249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.511342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.511474] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.511563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.511626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.511823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.511952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.512016] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.512144] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.696750] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.697495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.697495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.698090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.698232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.698375] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46786056-6b70-4ba1-a412-a7042077532f already deleted. [ 1184.698492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.841287] env[66157]: INFO networking_nsxv3.common.synchronization [req-905f2a7e-b4e6-4f93-b219-7dfd2fed1865 req-902e1f17-c21a-4fdc-ba59-935f45fd7808 tempest-ListServerFiltersTestJSON-1619138676 tempest-ListServerFiltersTestJSON-1619138676-project-member] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1184.841287] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1184.841505] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.841621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.841687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.841874] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.842390] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.842611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.842728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.842959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.843183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.843345] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.015402] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94: rpc.has_security_group_logging(os_id): False [ 1185.033472] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.033472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.033472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.033472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.033472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.033472] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.033472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.033713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.033713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.033713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.033956] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.034105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.034105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.034315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.034315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.034492] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.034578] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.034632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.035278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.035392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.035489] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1185.106730] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.106906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.106977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.107219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.107381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.122725] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1185.345415] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.848468] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.351267] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.351457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.351457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.351780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.351892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.352013] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1186.384091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.384323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.384323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.384594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.384651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.394490] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1187.139168] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1187.139547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.256717] env[66157]: INFO networking_nsxv3.common.synchronization [req-a879677d-8adf-4f65-b759-778e4ffa5f24 req-fc4fff06-b5bd-4254-aac3-43b9124cecdd tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 1187.256921] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 1187.257331] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.257518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.257635] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.259072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.259072] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.259072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.259072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.259072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.259072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.259072] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.588748] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.588748] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.588981] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.590169] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.590169] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.590457] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.590655] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.590884] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.591142] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.591387] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.591535] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.591750] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.591925] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.592097] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.592256] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.592412] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.620666] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.620755] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1187.620879] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.621143] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.621524] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.621721] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.621840] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.622184] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.622394] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6cb0f8-1f82-4969-89e1-159e3da1d6ec',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.762162] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.762378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.762443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.762675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.762763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.763463] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.763463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.763463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.763463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.763463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.763860] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be deleted. [ 1187.800152] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.800328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.800391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.800628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.800692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.800788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.125720] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.126020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.126134] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.126399] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.126552] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.126708] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec not found, creating... [ 1188.126975] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.127151] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.127265] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.127485] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.127616] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.127894] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.128053] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.128200] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.128418] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.128551] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.128707] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec is going to be created. [ 1188.148648] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.149049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.149160] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.149446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.149669] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.149893] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.405465] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1188.405726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.849230] env[66157]: INFO networking_nsxv3.common.synchronization [req-a879677d-8adf-4f65-b759-778e4ffa5f24 req-c09efd90-2a3b-46a7-82cc-81a41bd884a1 service nova] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_rules [ 1188.849872] env[66157]: INFO networking_nsxv3.common.synchronization [req-a879677d-8adf-4f65-b759-778e4ffa5f24 req-c09efd90-2a3b-46a7-82cc-81a41bd884a1 service nova] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 1188.849872] env[66157]: INFO networking_nsxv3.common.synchronization [req-a879677d-8adf-4f65-b759-778e4ffa5f24 req-c09efd90-2a3b-46a7-82cc-81a41bd884a1 service nova] Enqueued Resource ID: 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec with Priority: HIGHEST for action port [ 1188.850100] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_rules [ 1188.850369] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 1188.850873] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec with Priority: HIGHEST for action port [ 1188.850873] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.851175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.851175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.851175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.851266] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.853043] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.853043] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.853043] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.853244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.853244] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.853389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.853389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.853617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.853727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.853819] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.855663] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.855663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.855663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.855663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.855663] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6cb0f8-1f82-4969-89e1-159e3da1d6ec',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.353548] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.353905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.358123] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec with status ACTIVE [ 1189.358346] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.358559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.358559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.359196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.359322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.359499] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.359610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.359661] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.359802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.359886] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.360339] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.360339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.360339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.360339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.360604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.360604] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec is going to be updated. [ 1189.361655] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.383186] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.383344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.383384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.383600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.383806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.383895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.515477] env[66157]: INFO networking_nsxv3.common.synchronization [req-1537f291-2797-4449-b0e7-761e7305f1da req-63f033e6-6a1f-44c7-8e3e-19903ca2832a tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1189.516254] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1189.516692] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.516870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.516979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.517348] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.517581] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.517738] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.517839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.518572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.518718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.518861] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.856440] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.856683] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.856785] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.857141] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.857359] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.857530] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.857640] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.857868] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.858047] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.858255] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.858377] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.858484] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.858592] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.858708] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.858810] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.858936] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.863573] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.879043] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.879043] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1189.879043] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.879043] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.880474] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.880474] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.880474] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.880474] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.880474] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5146c77b-b0c5-4044-b4b5-3d650ad4bf34',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.022496] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.022496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.022496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.022496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.022704] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.022704] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.022820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.022866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.023124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.023124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.023277] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46786056-6b70-4ba1-a412-a7042077532f already deleted. [ 1190.023277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.368296] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.368687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.368687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.368854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.368854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.369032] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be created. [ 1190.383540] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.383787] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.383861] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.384254] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.384409] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.384564] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 5146c77b-b0c5-4044-b4b5-3d650ad4bf34 not found, creating... [ 1190.384831] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.385014] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.385235] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.385461] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.385594] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.385875] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.386037] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.386155] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.386397] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.386534] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.386671] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 5146c77b-b0c5-4044-b4b5-3d650ad4bf34 is going to be created. [ 1190.400658] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.400824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.400824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.401044] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.401250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.408413] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.408634] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.408713] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.408963] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.409203] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.409429] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.410766] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: UNINITIALIZED for 2s [ 1191.170795] env[66157]: INFO networking_nsxv3.common.synchronization [req-1537f291-2797-4449-b0e7-761e7305f1da req-e9510b16-db10-4bbb-b8fa-d76d0c187af9 service nova] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_rules [ 1191.170984] env[66157]: INFO networking_nsxv3.common.synchronization [req-1537f291-2797-4449-b0e7-761e7305f1da req-e9510b16-db10-4bbb-b8fa-d76d0c187af9 service nova] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1191.171139] env[66157]: INFO networking_nsxv3.common.synchronization [req-1537f291-2797-4449-b0e7-761e7305f1da req-e9510b16-db10-4bbb-b8fa-d76d0c187af9 service nova] Enqueued Resource ID: 5146c77b-b0c5-4044-b4b5-3d650ad4bf34 with Priority: HIGHEST for action port [ 1191.171706] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_rules [ 1191.171843] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1191.171963] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5146c77b-b0c5-4044-b4b5-3d650ad4bf34 with Priority: HIGHEST for action port [ 1191.172280] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.172421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.172487] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.172695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.172777] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.173609] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.173697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.173757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.173914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.174109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.174246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.174246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.174442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.174482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.174990] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.176770] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.176770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.176770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.176770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.176770] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5146c77b-b0c5-4044-b4b5-3d650ad4bf34',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.678868] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.679153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.679312] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.680102] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5146c77b-b0c5-4044-b4b5-3d650ad4bf34 with status ACTIVE [ 1191.680402] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.680470] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.680528] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.681486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.681486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.681486] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.681486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.681486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.681486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.681486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.681814] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.681945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.681996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.683769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.683769] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.683769] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5146c77b-b0c5-4044-b4b5-3d650ad4bf34 is going to be updated. [ 1191.705418] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.705814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.705978] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.706302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.706537] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.706820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5146c77b-b0c5-4044-b4b5-3d650ad4bf34" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.184406] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.421490] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: SUCCESS [ 1192.421695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.421846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.422165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.422330] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.422455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.422533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.422632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.422705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.422777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.423246] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.687267] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.687645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.687645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.687924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.688071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.688240] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46786056-6b70-4ba1-a412-a7042077532f is going to be created. [ 1192.733445] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.733663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.733663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.733968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.736963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.757505] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: UNINITIALIZED for 2s [ 1192.928024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.928024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.928024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.928024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.928024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.928890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.928890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.928890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.928890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.928890] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.431248] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6a87886-c2f5-4505-92ee-9c2a202b7b93: rpc.has_security_group_logging(os_id): False [ 1193.450917] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.451201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.451201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.451353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.451444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.451647] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.451741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.451805] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.451960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.452069] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.452262] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.452358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.452419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.452555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.452628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.452812] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.452903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.452961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.453113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.453185] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.453269] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be created. [ 1193.523669] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.523669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.523669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.524165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.524165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.537336] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: IN_PROGRESS for 2s [ 1193.816920] env[66157]: INFO networking_nsxv3.common.synchronization [req-088b91a5-6f99-482d-bf97-0e36f59718b5 req-3de35359-512b-4408-93ea-e08b508bf6b8 tempest-ListServerFiltersTestJSON-1619138676 tempest-ListServerFiltersTestJSON-1619138676-project-member] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1193.817767] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1193.817853] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.817975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.818579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.818817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.818988] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.819104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.819165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.820057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.820057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.820057] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.321977] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.764020] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: SUCCESS [ 1194.764020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.764224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.764388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.765037] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.765037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.765037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.765037] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.765274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.765274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.765274] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.825189] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.267511] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.327775] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.327976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.328184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.328425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.328574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.328736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1195.357620] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.357783] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.357856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.358167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.358243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.366853] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1195.552518] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: SUCCESS [ 1195.552746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.769844] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46786056-6b70-4ba1-a412-a7042077532f: rpc.has_security_group_logging(os_id): False [ 1195.799117] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.799117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.799117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.799429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.799429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.799672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.799776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.799870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.800032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.800114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.800215] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46786056-6b70-4ba1-a412-a7042077532f is going to be created. [ 1195.879056] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.879359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.879399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.879659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.879870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.897313] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: IN_PROGRESS for 2s [ 1197.377234] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1197.377494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.693871] env[66157]: INFO networking_nsxv3.common.synchronization [req-dc59577b-fdde-43cc-aa5d-86591f42f013 req-6095a4c5-2709-4518-b133-951cfea79165 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 1197.694862] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGHEST for action security_group_members [ 1197.695351] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.695546] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.695658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.695961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.696222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.696392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.696506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.696764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.696919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.697261] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.751064] env[66157]: INFO networking_nsxv3.common.synchronization [req-dc59577b-fdde-43cc-aa5d-86591f42f013 req-6095a4c5-2709-4518-b133-951cfea79165 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec with Priority: HIGHEST for action port [ 1197.751780] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec with Priority: HIGHEST for action port [ 1197.752263] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.752408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.752478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.752722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.752816] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6cb0f8-1f82-4969-89e1-159e3da1d6ec',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.909678] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: SUCCESS [ 1197.909916] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.200289] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.200644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.200823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.201012] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.201133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.201329] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.201436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.201492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.201647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.201722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.201815] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be updated. [ 1198.239023] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.239023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.239023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.239291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.239427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.251127] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: IN_PROGRESS for 2s [ 1198.255636] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec with status ACTIVE [ 1198.255886] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.256013] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.256132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.256132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.256132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.256132] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.256132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.256132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.256132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.257323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.257323] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.257323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.257486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.257515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.257589] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.257673] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d6cb0f8-1f82-4969-89e1-159e3da1d6ec is going to be updated. [ 1198.296470] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.296621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.296692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.297033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.297365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.297554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d6cb0f8-1f82-4969-89e1-159e3da1d6ec" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.264928] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 in Status: SUCCESS [ 1200.265342] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 deletion is rescheduled due to dependency. [ 1200.265342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.194312] env[66157]: INFO networking_nsxv3.common.synchronization [req-3b3b2e4b-26ae-4281-92d8-ea6115257c5c req-607d33df-db66-44f9-92d7-21366415a0c6 tempest-ListServerFiltersTestJSON-1619138676 tempest-ListServerFiltersTestJSON-1619138676-project-member] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1201.194902] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGHEST for action security_group_members [ 1201.195263] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.195385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.195457] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.195652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.195801] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.195893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.195954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.196108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.196224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.196360] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.699834] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.700240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.700240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.700424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.700577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.700885] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.701076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.701192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.701429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.701560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.701657] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be updated. [ 1201.738808] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.739062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.739199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.739490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.739708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.753076] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: IN_PROGRESS for 2s [ 1203.766202] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 in Status: SUCCESS [ 1203.766600] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 deletion is rescheduled due to dependency. [ 1203.766600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.196618] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.196618] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1207.629492] env[66157]: INFO networking_nsxv3.common.synchronization [req-230ea0fb-9826-47fb-be6b-6b28e8bf44f9 req-c2dbc48f-1724-4f9a-b3fa-83745648a3d6 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1207.630108] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1207.630441] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.630562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.630629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.631060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.631060] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.631060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.631264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.631264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.631377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.631478] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.047299] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.047299] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.047299] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.048137] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.048476] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.048813] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.049083] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.049437] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.052025] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.052025] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.052025] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.052025] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.052025] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.052025] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.052025] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.052025] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.079555] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.079555] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1208.079555] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.079555] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.079555] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-0838714d-d4ae-4e26-9275-83547046d043 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.079555] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-0838714d-d4ae-4e26-9275-83547046d043" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.079555] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-0838714d-d4ae-4e26-9275-83547046d043" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.079555] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-0838714d-d4ae-4e26-9275-83547046d043" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.079555] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0838714d-d4ae-4e26-9275-83547046d043',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.133488] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.504320] env[66157]: INFO networking_nsxv3.common.synchronization [None req-cb80f4e2-b02c-4dad-8a84-4bf86fa93079 None None] Enqueued Resource ID: 0fb4f0b9-bb4e-41e3-93d9-28fbb5034916 with Priority: HIGHEST for action port [ 1208.504320] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fb4f0b9-bb4e-41e3-93d9-28fbb5034916 with Priority: HIGHEST for action port [ 1208.505325] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fb4f0b9-bb4e-41e3-93d9-28fbb5034916 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.505752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fb4f0b9-bb4e-41e3-93d9-28fbb5034916" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.505895] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fb4f0b9-bb4e-41e3-93d9-28fbb5034916" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.506237] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fb4f0b9-bb4e-41e3-93d9-28fbb5034916" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.506425] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fb4f0b9-bb4e-41e3-93d9-28fbb5034916',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.583809] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.583809] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.583809] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.584273] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.584589] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.584712] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 0838714d-d4ae-4e26-9275-83547046d043 not found, creating... [ 1208.585172] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.585517] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.585682] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.586027] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.589254] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.589254] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.589254] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.589254] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.589254] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.589254] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.589254] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 0838714d-d4ae-4e26-9275-83547046d043 is going to be created. [ 1208.611592] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.611789] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.611871] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.612298] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.612632] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.612805] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-0838714d-d4ae-4e26-9275-83547046d043" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.636480] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.009184] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fb4f0b9-bb4e-41e3-93d9-28fbb5034916 [ 1209.009447] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.009574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.009644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.009865] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.009945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.010074] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fb4f0b9-bb4e-41e3-93d9-28fbb5034916 already deleted. [ 1209.010162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fb4f0b9-bb4e-41e3-93d9-28fbb5034916" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.141330] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.141330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.141330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.141330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.141330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.141330] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46786056-6b70-4ba1-a412-a7042077532f is going to be updated. [ 1209.174391] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.175221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.175221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.175221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.175221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.184205] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: IN_PROGRESS for 2s [ 1209.349908] env[66157]: INFO networking_nsxv3.common.synchronization [req-230ea0fb-9826-47fb-be6b-6b28e8bf44f9 req-eab6e69a-e822-4e56-a323-26f9e96ebb0b service nova] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_rules [ 1209.350211] env[66157]: INFO networking_nsxv3.common.synchronization [req-230ea0fb-9826-47fb-be6b-6b28e8bf44f9 req-eab6e69a-e822-4e56-a323-26f9e96ebb0b service nova] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1209.350211] env[66157]: INFO networking_nsxv3.common.synchronization [req-230ea0fb-9826-47fb-be6b-6b28e8bf44f9 req-eab6e69a-e822-4e56-a323-26f9e96ebb0b service nova] Enqueued Resource ID: 0838714d-d4ae-4e26-9275-83547046d043 with Priority: HIGHEST for action port [ 1209.350753] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_rules [ 1209.350896] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1209.351040] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0838714d-d4ae-4e26-9275-83547046d043 with Priority: HIGHEST for action port [ 1209.351288] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.351451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.351488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.352039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.352039] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.353543] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.353543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.353845] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-0838714d-d4ae-4e26-9275-83547046d043 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.353845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0838714d-d4ae-4e26-9275-83547046d043" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.353845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0838714d-d4ae-4e26-9275-83547046d043" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.355810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0838714d-d4ae-4e26-9275-83547046d043" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.355810] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0838714d-d4ae-4e26-9275-83547046d043',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.857233] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.857464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.858730] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0838714d-d4ae-4e26-9275-83547046d043 with status ACTIVE [ 1209.858927] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.859071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.859317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.859749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.859858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.860062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.860199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.860240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.860379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.860456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.860633] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.860725] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.860850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.860919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.861014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.861621] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0838714d-d4ae-4e26-9275-83547046d043 is going to be updated. [ 1209.885171] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.885346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.885346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.885503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.885629] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.885802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0838714d-d4ae-4e26-9275-83547046d043" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.630777] env[66157]: INFO networking_nsxv3.common.synchronization [None req-83d9f4d1-17af-4759-9b4b-ab50ff127716 None None] Enqueued Resource ID: d6b41644-da27-415d-af9d-9474a87f102e with Priority: HIGHEST for action port [ 1210.631023] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b41644-da27-415d-af9d-9474a87f102e with Priority: HIGHEST for action port [ 1210.631217] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6b41644-da27-415d-af9d-9474a87f102e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.632174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6b41644-da27-415d-af9d-9474a87f102e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.632174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6b41644-da27-415d-af9d-9474a87f102e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.632174] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6b41644-da27-415d-af9d-9474a87f102e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.632174] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b41644-da27-415d-af9d-9474a87f102e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.134388] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6b41644-da27-415d-af9d-9474a87f102e [ 1211.134662] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.134747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.134800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.135057] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.135147] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.135266] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6b41644-da27-415d-af9d-9474a87f102e already deleted. [ 1211.135388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6b41644-da27-415d-af9d-9474a87f102e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.196341] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: SUCCESS [ 1211.196588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.196773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.197039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.197369] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.197369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.197451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.197654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.197739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.197850] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.700209] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.202738] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.706150] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.706341] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.706341] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.706554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.706645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.706746] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46786056-6b70-4ba1-a412-a7042077532f is going to be updated. [ 1212.748882] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.749105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.749105] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.749314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.749462] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.760475] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: IN_PROGRESS for 2s [ 1214.071656] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-d0d5903f-2f82-44d7-9554-256ef41649aa tempest-ListServersNegativeTestJSON-132682382 tempest-ListServersNegativeTestJSON-132682382-project-member] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1214.072313] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1214.072896] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.072896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.072896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.073362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.073448] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.073510] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.073545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.073736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.073846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.073988] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.399413] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.399661] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.399797] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.400207] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.400474] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.400628] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.400769] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.401232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.401413] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.401649] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1214.401761] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.401867] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.401999] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.402123] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1214.402230] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.402357] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.426021] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.426021] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1214.426021] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.426021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.426021] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.426021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.426021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.426021] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.426021] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e832d4db-aa1b-4ca1-b27a-81c396e4d6a9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.577197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.577417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.577531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.577768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.577859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.578119] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.578240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.578331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.578530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.578617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.578706] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 already deleted. [ 1214.578786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.771099] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: SUCCESS [ 1214.771099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.771272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.771603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.771642] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.771726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.771793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.771941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.772039] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.772142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.772234] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.929072] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.929072] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.929072] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.929354] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.929470] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.929627] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port e832d4db-aa1b-4ca1-b27a-81c396e4d6a9 not found, creating... [ 1214.929924] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.930103] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.930224] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.930435] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.930574] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.930898] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.931067] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.931186] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.931388] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.931521] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.931660] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: e832d4db-aa1b-4ca1-b27a-81c396e4d6a9 is going to be created. [ 1214.951225] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.951462] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.951576] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.951844] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.952131] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.952445] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.274774] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.731138] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-ad7700f7-4d0f-4a13-997f-91802cc99f0b service nova] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_rules [ 1215.731319] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-ad7700f7-4d0f-4a13-997f-91802cc99f0b service nova] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1215.731453] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-ad7700f7-4d0f-4a13-997f-91802cc99f0b service nova] Enqueued Resource ID: e832d4db-aa1b-4ca1-b27a-81c396e4d6a9 with Priority: HIGHEST for action port [ 1215.732171] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_rules [ 1215.732244] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1215.732297] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e832d4db-aa1b-4ca1-b27a-81c396e4d6a9 with Priority: HIGHEST for action port [ 1215.732578] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.732699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.732765] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.733560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.733796] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.734990] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.736270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.736270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.736270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.736270] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.736270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.736270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.736270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.736270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.736270] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.737243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.737384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.737447] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.737558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.737634] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e832d4db-aa1b-4ca1-b27a-81c396e4d6a9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.777071] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46786056-6b70-4ba1-a412-a7042077532f: rpc.has_security_group_logging(os_id): False [ 1215.805249] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.805547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.805547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.805671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.805754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.806075] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.806178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.806249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.806398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.806476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.806567] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46786056-6b70-4ba1-a412-a7042077532f is going to be updated. [ 1215.878591] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.878773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.878913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.879202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.879318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.900194] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: IN_PROGRESS for 2s [ 1216.239363] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.239511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.239697] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.240853] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e832d4db-aa1b-4ca1-b27a-81c396e4d6a9 with status ACTIVE [ 1216.240960] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.241061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.241061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.241733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.241733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.241733] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.241733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.241733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.242171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.242171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.242171] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.242335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.242335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.242505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.242505] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.242579] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e832d4db-aa1b-4ca1-b27a-81c396e4d6a9 is going to be updated. [ 1216.270285] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.270481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.270590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.270861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.271071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.271306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e832d4db-aa1b-4ca1-b27a-81c396e4d6a9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.437052] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-44a84aa3-d5d7-431f-9d42-e73e72775311 tempest-ListServersNegativeTestJSON-132682382 tempest-ListServersNegativeTestJSON-132682382-project-member] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1216.438117] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1216.438117] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.438117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.744719] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.776810] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.777040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.777202] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.777471] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.777758] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.777904] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.778186] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.778439] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.778595] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.778884] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.779011] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.779124] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.779234] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.779830] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.779983] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.780172] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.800412] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.800730] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1216.800841] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.801146] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.801479] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-258647e7-c051-4b91-b08d-d32dff9424a6 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.801705] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-258647e7-c051-4b91-b08d-d32dff9424a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.801849] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-258647e7-c051-4b91-b08d-d32dff9424a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.802188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-258647e7-c051-4b91-b08d-d32dff9424a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.802509] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('258647e7-c051-4b91-b08d-d32dff9424a6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.249634] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.252246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.252246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.252246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.252246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.252246] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be created. [ 1217.285547] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.285547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.287608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.287608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.287608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.296057] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: UNINITIALIZED for 2s [ 1217.305534] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.305534] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.305534] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.305771] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.305924] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.306095] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 258647e7-c051-4b91-b08d-d32dff9424a6 not found, creating... [ 1217.306532] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.306532] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.306684] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.306858] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.306991] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.307292] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.307449] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.307563] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.307763] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.307897] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.308047] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 258647e7-c051-4b91-b08d-d32dff9424a6 is going to be created. [ 1217.328527] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.328754] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.328841] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.329127] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.329368] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.329587] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-258647e7-c051-4b91-b08d-d32dff9424a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.842368] env[66157]: INFO networking_nsxv3.common.synchronization [None req-e1310e6a-b212-4180-b7a4-c5ae40ea5738 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1217.842843] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1217.843211] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.843359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.843436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.843732] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.843909] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.844107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.844191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.844379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.844474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.844591] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.912702] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: SUCCESS [ 1217.912999] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.060231] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-a2703491-6694-46b4-831e-156ed26417b0 service nova] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_rules [ 1218.060359] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-a2703491-6694-46b4-831e-156ed26417b0 service nova] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1218.060521] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-a2703491-6694-46b4-831e-156ed26417b0 service nova] Enqueued Resource ID: 258647e7-c051-4b91-b08d-d32dff9424a6 with Priority: HIGHEST for action port [ 1218.061043] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_rules [ 1218.061183] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1218.061283] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 258647e7-c051-4b91-b08d-d32dff9424a6 with Priority: HIGHEST for action port [ 1218.061563] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.061784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.061906] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.061984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.062404] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-258647e7-c051-4b91-b08d-d32dff9424a6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.062476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-258647e7-c051-4b91-b08d-d32dff9424a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.062515] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-258647e7-c051-4b91-b08d-d32dff9424a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.063153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-258647e7-c051-4b91-b08d-d32dff9424a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.063312] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('258647e7-c051-4b91-b08d-d32dff9424a6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.347431] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.347607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.347670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.347901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.347994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.348216] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.348315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.348371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.348513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.348588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.348677] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1218.377646] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.377788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.377856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.378089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.379023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.390349] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1218.569509] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 258647e7-c051-4b91-b08d-d32dff9424a6 with status ACTIVE [ 1218.569695] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.569832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.569902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.570146] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.570239] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.570430] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.570535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.570597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.570752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.570828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.571027] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.571110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.571183] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.571304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.571377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.571463] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 258647e7-c051-4b91-b08d-d32dff9424a6 is going to be updated. [ 1218.597838] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.599087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.599233] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.599530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.599619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.599772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-258647e7-c051-4b91-b08d-d32dff9424a6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.774878] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-b235cf88-da2b-4949-a962-2d29962521ee tempest-ListServersNegativeTestJSON-132682382 tempest-ListServersNegativeTestJSON-132682382-project-member] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1218.775585] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1218.775904] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.776022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.125524] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.125880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.127080] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.127080] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.127219] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.127396] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.127561] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.127828] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.128066] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.128331] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.128493] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.128645] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.128796] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.128950] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.129121] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.129306] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.149359] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.149559] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.149699] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.149875] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-471" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.150235] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.150598] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.150758] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.151105] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.151235] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4891ffd-599e-4db3-ae26-b86c6fc32e0f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.317395] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1219.317743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.319891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.319891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.319891] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.319891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.319891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.319891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.319891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.319891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.319891] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.319891] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.320501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.320501] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.320501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.320501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.320665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.320710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.320770] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.653534] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.653740] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.653869] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.654255] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.654413] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.654570] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port b4891ffd-599e-4db3-ae26-b86c6fc32e0f not found, creating... [ 1219.654824] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.654979] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.655146] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.655385] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.655523] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.655802] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.655954] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.656080] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.656286] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.656417] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.656817] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: b4891ffd-599e-4db3-ae26-b86c6fc32e0f is going to be created. [ 1219.676623] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.676836] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.676954] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.677256] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.677496] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.677721] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.823306] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.823516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.823621] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.328634] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.407886] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1220.408245] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e deletion is rescheduled due to dependency. [ 1220.408486] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.419361] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-620d9300-b25a-4e27-9b74-74ce1222feee service nova] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_rules [ 1220.419549] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-620d9300-b25a-4e27-9b74-74ce1222feee service nova] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1220.419687] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f7dce87-9da0-438f-8faf-edf9d601740d req-620d9300-b25a-4e27-9b74-74ce1222feee service nova] Enqueued Resource ID: b4891ffd-599e-4db3-ae26-b86c6fc32e0f with Priority: HIGHEST for action port [ 1220.420233] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_rules [ 1220.420366] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1220.420461] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4891ffd-599e-4db3-ae26-b86c6fc32e0f with Priority: HIGHEST for action port [ 1220.420736] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.420834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.421126] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.421301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.421484] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.421607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.421699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.421919] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.422063] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4891ffd-599e-4db3-ae26-b86c6fc32e0f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.831957] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.832138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.832138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.832359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.832482] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.832578] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be updated. [ 1220.884626] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.884826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.884826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.885078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.885243] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.895984] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: IN_PROGRESS for 2s [ 1220.924705] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4891ffd-599e-4db3-ae26-b86c6fc32e0f with status ACTIVE [ 1220.925017] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.925240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.925317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.925501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.925592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.925783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.925890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.925970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.926117] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.926195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.926387] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.926477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.926530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.926675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.926749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.926837] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4891ffd-599e-4db3-ae26-b86c6fc32e0f is going to be updated. [ 1220.948765] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.948911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.949012] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.949339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.949544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.949702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4891ffd-599e-4db3-ae26-b86c6fc32e0f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.904997] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1222.905410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.905410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.905611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.905793] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.905907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.905974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.906140] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.906219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.906317] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.409012] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.911661] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.414245] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.414385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.414429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.414614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.414713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.414814] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be updated. [ 1224.443026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.443026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.443026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.443026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.443026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.452328] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: IN_PROGRESS for 2s [ 1224.912472] env[66157]: INFO networking_nsxv3.common.synchronization [req-4066026b-3b90-4f2a-a226-2cd819c0d0f0 req-21b747e9-2a88-42e7-9b88-1e66351b17bf tempest-DeleteServersTestJSON-630911980 tempest-DeleteServersTestJSON-630911980-project-member] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1224.912472] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGHEST for action security_group_members [ 1224.912954] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.912954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.912954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.913359] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.913412] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.913509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.913592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.914564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.914564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.914564] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.417806] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.418035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.418266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.418615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.418791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.419142] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.419315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.419518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.419828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.419987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.420254] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be updated. [ 1225.454909] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.455133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.455249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.455504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.455694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.472289] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: IN_PROGRESS for 2s [ 1226.463140] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1226.463511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.463656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.463908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.464207] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.464453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.464596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.464857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.465026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.465210] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.968284] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.471326] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.483161] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 in Status: SUCCESS [ 1227.483509] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 deletion is rescheduled due to dependency. [ 1227.483509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.974904] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.975219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.975365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.975620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.975724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.975858] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be updated. [ 1228.006178] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.006385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.006439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.006666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.006818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.015883] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: IN_PROGRESS for 2s [ 1229.240567] env[66157]: INFO networking_nsxv3.common.synchronization [req-a59f39fb-6e97-453d-931e-eabc35c0fda9 req-68526a22-a5bc-4ca2-ba6a-bbdf5441af7c tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 1229.240567] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 1229.240567] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.240567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.240567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.240567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.240567] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.240567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.240567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.240567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.240567] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.240567] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.538749] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.538948] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.539737] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.539737] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.539886] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.540090] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.540218] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.540440] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.540587] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.540793] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1229.540907] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1229.541026] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1229.541135] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1229.541246] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1229.541348] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1229.541477] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1229.566923] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1229.567104] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1229.567247] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1229.567428] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-908" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.567751] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-90cef4da-8874-4c41-8979-fc656f485381 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.567947] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-90cef4da-8874-4c41-8979-fc656f485381" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.568056] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-90cef4da-8874-4c41-8979-fc656f485381" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.568374] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-90cef4da-8874-4c41-8979-fc656f485381" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.568530] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90cef4da-8874-4c41-8979-fc656f485381',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.743408] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.027131] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1230.027371] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.027548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.027770] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.027959] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.028087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.028149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.028302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.028380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.028464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.028625] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.028701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.028762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.028894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.029043] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.029133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.029193] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.029322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.029409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.029495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.029580] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.030439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.030598] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.030741] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.030837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.030899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.031050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.031129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.031214] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.070945] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.071578] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.071578] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.071578] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.071730] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.071873] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 90cef4da-8874-4c41-8979-fc656f485381 not found, creating... [ 1230.072177] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.072342] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.072461] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.072678] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.072875] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.073454] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.073454] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.073454] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.073656] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.073792] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.073928] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 90cef4da-8874-4c41-8979-fc656f485381 is going to be created. [ 1230.094531] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.094531] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.094746] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.095092] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.095346] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.095593] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-90cef4da-8874-4c41-8979-fc656f485381" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.246105] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.533441] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bd2d62b-4adc-4dd4-ae60-c234c9457286: rpc.has_security_group_logging(os_id): False [ 1230.534766] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.552109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.552259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.552329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.552531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.552620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.552829] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.552924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.552985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.553144] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.553218] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.553425] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.553526] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.553599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.553735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.553809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.553991] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.554279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.554279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.554376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.554376] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.554503] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be created. [ 1230.627706] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.627706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.627706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.628184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.628184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.642921] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: IN_PROGRESS for 2s [ 1230.749536] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.749707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.749707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.750321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.750416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.750513] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 is going to be updated. [ 1230.781928] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.782266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.782266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.782579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.782616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.793509] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: IN_PROGRESS for 2s [ 1230.820539] env[66157]: INFO networking_nsxv3.common.synchronization [req-a59f39fb-6e97-453d-931e-eabc35c0fda9 req-5cfcc997-7137-43a7-afed-d16c746482c7 service nova] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_rules [ 1230.820742] env[66157]: INFO networking_nsxv3.common.synchronization [req-a59f39fb-6e97-453d-931e-eabc35c0fda9 req-5cfcc997-7137-43a7-afed-d16c746482c7 service nova] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 1230.820970] env[66157]: INFO networking_nsxv3.common.synchronization [req-a59f39fb-6e97-453d-931e-eabc35c0fda9 req-5cfcc997-7137-43a7-afed-d16c746482c7 service nova] Enqueued Resource ID: 90cef4da-8874-4c41-8979-fc656f485381 with Priority: HIGHEST for action port [ 1230.821749] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_rules [ 1230.821891] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 1230.822031] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90cef4da-8874-4c41-8979-fc656f485381 with Priority: HIGHEST for action port [ 1230.822350] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.822491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.822521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.822727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.822807] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.823758] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.823918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.824213] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-90cef4da-8874-4c41-8979-fc656f485381 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.824346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90cef4da-8874-4c41-8979-fc656f485381" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.824411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90cef4da-8874-4c41-8979-fc656f485381" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.824596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90cef4da-8874-4c41-8979-fc656f485381" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.824672] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90cef4da-8874-4c41-8979-fc656f485381',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.038298] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.326611] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.327192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.327192] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90cef4da-8874-4c41-8979-fc656f485381 with status ACTIVE [ 1231.327359] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.327475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.327542] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.327747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.327866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.328026] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.328196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.328269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.328432] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.328565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.328764] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.328899] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.328966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.329153] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.329268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.329411] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90cef4da-8874-4c41-8979-fc656f485381 is going to be updated. [ 1231.352380] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.352604] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.352675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.352994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.353242] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.353489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90cef4da-8874-4c41-8979-fc656f485381" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.540418] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.540682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.540682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.540822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.540901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.541024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be updated. [ 1231.574808] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.574907] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.574954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.575227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.575385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.584428] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: IN_PROGRESS for 2s [ 1232.451971] env[66157]: INFO networking_nsxv3.common.synchronization [req-6f5b56bc-ee21-4c1a-98c0-0a8947302871 req-8df908a9-134d-468a-8723-f7a968cd3eb5 tempest-ListServersNegativeTestJSON-132682382 tempest-ListServersNegativeTestJSON-132682382-project-member] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1232.451971] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1232.451971] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.451971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.657872] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1232.657872] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.658038] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.658287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.658375] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.806158] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: SUCCESS [ 1232.806384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.806593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.806844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.807085] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.807224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.807304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.807489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.807574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.807681] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.160803] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.160803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.311232] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.593953] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1233.594400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.594400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.594633] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.594795] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.594911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.594972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.595190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.595282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.595396] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.814243] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.097279] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.318284] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.318284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.318284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.318284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.318284] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.318284] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 is going to be updated. [ 1234.349851] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.349851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.349851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.349851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.349851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.361180] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: IN_PROGRESS for 2s [ 1234.600266] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.102697] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.102875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.102993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.103399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.103399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.103586] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be updated. [ 1235.133408] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.133599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.133599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.134480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.134480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.146352] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: IN_PROGRESS for 2s [ 1236.371669] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: SUCCESS [ 1236.372074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.372189] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.372386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.372578] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.372695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.372756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.372936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.373171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.373171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.373298] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.876342] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.157190] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1237.158346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.158346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.158346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.158346] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.158346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.158346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.158669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.158669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.158669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.158758] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.379704] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d46b1e4e-446b-4001-9e14-1ab5b40a8087: rpc.has_security_group_logging(os_id): False [ 1237.399733] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.400034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.400034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.400226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.423451] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.423923] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.424138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.424225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.424509] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.424640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.424787] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 is going to be updated. [ 1237.452319] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.452529] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1237.487227] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.487444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.487444] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.487586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.487747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.498947] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: IN_PROGRESS for 2s [ 1237.661081] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.661315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.661412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.661642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.661811] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.661913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.661976] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.662161] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.662310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.662421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.662577] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.662673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.662743] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.662879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.663032] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.663130] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.663229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.663360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.663440] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.663524] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.663681] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.166020] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bd2d62b-4adc-4dd4-ae60-c234c9457286: rpc.has_security_group_logging(os_id): False [ 1238.184930] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.185139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.185212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.185399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.185492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.185714] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.185815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.185879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.186041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.186123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.186301] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.186395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.186452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.186591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.186663] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.186848] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.186942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.187010] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.187151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.187223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.187334] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be updated. [ 1238.248064] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.248272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.248345] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.248767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.248767] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.264418] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: IN_PROGRESS for 2s [ 1239.233470] env[66157]: INFO networking_nsxv3.common.synchronization [req-300d6075-87ec-4de2-81af-9e9a516eed05 req-28fd5c68-f61c-4bb9-9c22-651531b2d86a tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1239.233811] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1239.234316] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.234466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.234758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.234839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.234975] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.235114] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.235188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.235375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.235464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.235565] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.513964] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: SUCCESS [ 1239.514306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.623586] env[66157]: INFO networking_nsxv3.common.synchronization [req-a12e7097-c1d4-4c66-98ea-a8b052fb9dea req-820ca173-a598-485a-afc5-efa85b2f97a9 tempest-ListServersNegativeTestJSON-132682382 tempest-ListServersNegativeTestJSON-132682382-project-member] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1239.624197] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1239.624527] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.624703] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.624887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.624956] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.626832] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.626958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.627042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.627337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.627503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.627724] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.637801] env[66157]: INFO networking_nsxv3.common.synchronization [req-968eb67c-25d9-47a3-9950-57d03da57c7d req-1013d1e0-8f03-4a59-8112-60f0ccb34480 tempest-ListServersNegativeTestJSON-132682382 tempest-ListServersNegativeTestJSON-132682382-project-member] Enqueued Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1239.638143] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 with Priority: HIGHEST for action security_group_members [ 1239.640022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd2d62b-4adc-4dd4-ae60-c234c9457286 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.640022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.738090] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.738277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.738320] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.738563] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.738757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.738984] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.739097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.739157] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.739319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.739466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.739560] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1239.764894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.765137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.765257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.765541] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.765643] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.774177] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1240.130062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.130365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.130512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.130841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.131035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.131375] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.131565] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.131697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.131929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.133195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.133195] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be updated. [ 1240.157506] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.157652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.157721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.157934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.158091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.166678] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: IN_PROGRESS for 2s [ 1240.281422] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1240.281795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.281890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.282127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.282218] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.803286] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.803518] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.803581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.803804] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.803898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.803988] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be deleted. [ 1240.855720] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.855964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.855964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.856154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.856250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.856370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.784391] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1241.784772] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 deletion is rescheduled due to dependency. [ 1241.784772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.176989] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 in Status: SUCCESS [ 1242.177188] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 deletion is rescheduled due to dependency. [ 1242.177303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.177464] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.177681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.177861] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.177975] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.178053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.178202] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.178282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.178539] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd2d62b-4adc-4dd4-ae60-c234c9457286',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.681100] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.681100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.681100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.681383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.681383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.681564] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.681666] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.681724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.681876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.681952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.682080] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd2d62b-4adc-4dd4-ae60-c234c9457286 is going to be deleted. [ 1242.725471] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.725640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.725711] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.725918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.726014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.726119] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd2d62b-4adc-4dd4-ae60-c234c9457286" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.638825] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1244.638825] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1244.890906] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.891124] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.891248] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.891506] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.891761] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.891910] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.892050] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.892262] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.892415] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.892623] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.892730] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.892835] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.892939] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.893057] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.893162] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.893311] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.914747] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.916042] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1244.916042] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.916042] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.916042] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.916042] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.916042] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.916615] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.916615] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fa8eac-6f23-48a0-b060-7bcfdafae0a8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.419508] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.419737] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.419838] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.420198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.420353] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.420512] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 not found, creating... [ 1245.420797] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.420978] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.421201] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.421446] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.421588] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.421870] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.422037] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.422154] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.422355] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.422485] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.422621] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 is going to be created. [ 1245.445442] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.445677] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.445783] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.446040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.446393] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.446644] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.149171] env[66157]: INFO networking_nsxv3.common.synchronization [req-464c00e1-0ba1-493d-bae9-a33b444158d8 req-f7e31126-804f-40b0-8b5d-6eaab3e623ff service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1246.149427] env[66157]: INFO networking_nsxv3.common.synchronization [req-464c00e1-0ba1-493d-bae9-a33b444158d8 req-f7e31126-804f-40b0-8b5d-6eaab3e623ff service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1246.149475] env[66157]: INFO networking_nsxv3.common.synchronization [req-464c00e1-0ba1-493d-bae9-a33b444158d8 req-f7e31126-804f-40b0-8b5d-6eaab3e623ff service nova] Enqueued Resource ID: d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 with Priority: HIGHEST for action port [ 1246.150503] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1246.150852] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1246.150852] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 with Priority: HIGHEST for action port [ 1246.151009] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.151195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.151195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.151391] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.151470] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.152936] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.152936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.152936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.153092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.153429] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.153429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.153429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.153581] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.153675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.153745] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.154905] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.154905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.154905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.154905] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.154905] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fa8eac-6f23-48a0-b060-7bcfdafae0a8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.657706] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.657706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.657873] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.658757] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 with status ACTIVE [ 1246.658937] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.659062] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.659128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.659322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.659419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.660489] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.660489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.660489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.660489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.660489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.660489] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.660489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.660489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.660489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.660838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.661039] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 is going to be updated. [ 1246.683883] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.684103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.684228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.684535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.684716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.684914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.162774] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.666428] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.666590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.666641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.666841] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.666929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.667127] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1247.696166] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.696313] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.696387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.696792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.696965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.705153] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1249.719066] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1249.719066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.719066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.719656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.719656] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.719656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.719656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.719942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.719942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.719942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.719942] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.222595] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.222842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.222842] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.223101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.223319] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.223415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.223415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.223575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.223659] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.223753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.223893] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.223980] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.224052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.224236] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.224338] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.224419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.224474] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.224611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.224681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.224760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.224846] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.727470] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fec754f5-f737-48ef-9255-9d4bc7df0c2e: rpc.has_security_group_logging(os_id): False [ 1250.747592] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.747771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.747814] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.748026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.748123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.748350] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.748453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.748506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.748670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.748746] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.748920] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.749020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.749231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.749231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.749312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.749468] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.749554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.749617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.749753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.749824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.749921] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1250.812917] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.813110] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.813171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.813342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.813553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.827665] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1251.151406] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1251.151579] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1252.851808] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1252.852245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.666312] env[66157]: INFO networking_nsxv3.common.synchronization [req-3d7254c1-0568-41dc-be36-5479eb96217e req-fb5a95c4-3f37-45c8-94be-0bc65966edf6 tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1253.667097] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1253.667173] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.668126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.668126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.668126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.668126] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.668468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.668468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.668468] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.668614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.668739] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.006034] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.006034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.006034] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.006448] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.006448] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.006604] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.006721] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.007198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.007198] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.007305] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1254.007422] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.007531] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.007636] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.007766] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1254.007884] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.008029] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.035523] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.036051] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1254.036275] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.036478] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-183" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.036880] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-04f5255b-ad5b-4d56-801c-94dd7d3808b1 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.037074] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-04f5255b-ad5b-4d56-801c-94dd7d3808b1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.037199] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-04f5255b-ad5b-4d56-801c-94dd7d3808b1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.037529] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-04f5255b-ad5b-4d56-801c-94dd7d3808b1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.037668] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04f5255b-ad5b-4d56-801c-94dd7d3808b1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.174608] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.174883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.174977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.175360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.175521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.175830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.175989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.176104] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.176364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.176493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.176630] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1254.215783] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.215989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.216052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.216270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.216517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.227346] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1254.540376] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.540703] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.540784] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.541028] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.541256] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.541465] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 04f5255b-ad5b-4d56-801c-94dd7d3808b1 not found, creating... [ 1254.541805] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.541989] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.542178] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.542458] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.542624] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.542960] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.543152] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.543340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.543645] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.543816] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.544015] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 04f5255b-ad5b-4d56-801c-94dd7d3808b1 is going to be created. [ 1254.567297] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.567588] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.567730] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.568055] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.568297] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.568550] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-04f5255b-ad5b-4d56-801c-94dd7d3808b1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.278075] env[66157]: INFO networking_nsxv3.common.synchronization [req-3d7254c1-0568-41dc-be36-5479eb96217e req-3974bd86-5af2-4761-861b-7c382d46e78e service nova] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 1255.278332] env[66157]: INFO networking_nsxv3.common.synchronization [req-3d7254c1-0568-41dc-be36-5479eb96217e req-3974bd86-5af2-4761-861b-7c382d46e78e service nova] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1255.278445] env[66157]: INFO networking_nsxv3.common.synchronization [req-3d7254c1-0568-41dc-be36-5479eb96217e req-3974bd86-5af2-4761-861b-7c382d46e78e service nova] Enqueued Resource ID: 04f5255b-ad5b-4d56-801c-94dd7d3808b1 with Priority: HIGHEST for action port [ 1255.278997] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_rules [ 1255.279469] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1255.279469] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04f5255b-ad5b-4d56-801c-94dd7d3808b1 with Priority: HIGHEST for action port [ 1255.279792] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.279960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.280570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.280570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.280570] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.281694] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.281694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.281694] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-04f5255b-ad5b-4d56-801c-94dd7d3808b1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.281694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04f5255b-ad5b-4d56-801c-94dd7d3808b1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.281961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04f5255b-ad5b-4d56-801c-94dd7d3808b1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.281961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04f5255b-ad5b-4d56-801c-94dd7d3808b1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.282038] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04f5255b-ad5b-4d56-801c-94dd7d3808b1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.786864] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.787014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.789480] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04f5255b-ad5b-4d56-801c-94dd7d3808b1 with status ACTIVE [ 1255.789629] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.789755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.789824] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.790109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.790215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.790418] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.790520] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.790574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.790761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.790852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.791067] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.791170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.791246] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.791385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.791460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.791548] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04f5255b-ad5b-4d56-801c-94dd7d3808b1 is going to be updated. [ 1255.815357] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.815555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.815611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.815839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.815996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.816187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04f5255b-ad5b-4d56-801c-94dd7d3808b1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.003281] env[66157]: INFO networking_nsxv3.common.synchronization [req-1c81e090-1311-4675-9d4d-8c7bd05a28fa req-7edb05a6-21ee-4ae6-92b6-cfabdf5d6cb9 tempest-AttachVolumeTestJSON-1599628970 tempest-AttachVolumeTestJSON-1599628970-project-member] Enqueued Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_members [ 1256.003549] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGHEST for action security_group_members [ 1256.004098] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.004098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.004354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.005400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.005400] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.005400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.005400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.005400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.005400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.005400] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.237523] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1256.237704] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 deletion is rescheduled due to dependency. [ 1256.237839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.237988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.238222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.238655] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.238819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.239754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.239754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.239754] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.239754] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.451387] env[66157]: INFO networking_nsxv3.common.synchronization [req-1db3f94d-2e0e-4230-a392-2bda72bee382 req-baa89a08-e10c-4607-bc71-286d2abc0b0a tempest-ServerActionsTestOtherB-552517833 tempest-ServerActionsTestOtherB-552517833-project-member] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1256.451387] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1256.452680] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.452996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.453225] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.453554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.453832] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.454095] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.455573] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.455573] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.455573] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.455573] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.507804] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.507946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.508027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.508253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.508335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.508517] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.508611] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.508669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.508811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.508879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.508962] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a is going to be updated. [ 1256.537603] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.537822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.537924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.538192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.538491] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.548107] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a in Status: IN_PROGRESS for 2s [ 1256.741058] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.958422] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.958591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.958664] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.958898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.989290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.989602] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.989755] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.989826] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.990041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.990126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.990214] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1257.021214] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.022387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.022387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.022387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.022387] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.031867] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1257.243148] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.746475] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.746868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.746868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.747220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.747374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.747519] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1257.775672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.775856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.775897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.776113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.776270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.785794] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1258.558795] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a in Status: SUCCESS [ 1258.558967] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a deletion is rescheduled due to dependency. [ 1258.559171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.042361] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1259.042760] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a deletion is rescheduled due to dependency. [ 1259.042760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.795440] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1259.795649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.795817] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.796060] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.796251] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.796363] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.796427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.796648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.796744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.796854] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.796916] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.299141] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.801710] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2381db7b-1b29-4dfc-a6af-48c498e3e0b0: rpc.has_security_group_logging(os_id): False [ 1260.903162] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.903386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.903533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.903793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.903880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.904208] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.904357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.904405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.904642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.904752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.904850] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1260.966979] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.967198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.967244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.967439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.967593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.981712] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1261.024947] env[66157]: INFO networking_nsxv3.common.synchronization [None req-2d15a69e-10dc-4d6b-9f17-a1e58d15e0ce tempest-AttachVolumeTestJSON-1599628970 tempest-AttachVolumeTestJSON-1599628970-project-member] Enqueued Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_rules [ 1261.025548] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_rules [ 1261.025886] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.026024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.026075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.026332] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.026415] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.118821] env[66157]: INFO networking_nsxv3.common.synchronization [None req-5cc55c4a-ddcf-4a8d-90f4-57e16a4a3f48 tempest-AttachVolumeTestJSON-1599628970 tempest-AttachVolumeTestJSON-1599628970-project-member] Enqueued Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_rules [ 1261.119366] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_rules [ 1261.119999] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.120338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.546228] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.546501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.546501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.546616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.546713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.546813] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a11d247-5b58-4309-be42-e273703c703a already deleted. [ 1261.546897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.547061] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.547226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.547306] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.064865] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-253 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.065107] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.065274] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.065595] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.065860] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.066022] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.066139] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.066351] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.066499] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.066704] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1262.066812] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1262.066927] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1262.067115] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1262.067256] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1262.067355] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1262.067487] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.070182] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.070304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.070357] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.070564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.070602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.070694] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a11d247-5b58-4309-be42-e273703c703a already deleted. [ 1262.070796] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.094796] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.094796] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1262.094796] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.094796] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-253" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.094796] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.094796] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.094796] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.094796] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.094796] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fa8eac-6f23-48a0-b060-7bcfdafae0a8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.596691] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.597098] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.597098] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.597320] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.597483] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.597784] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.597942] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.598098] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.598336] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.598483] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.598760] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.598913] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.599045] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.599246] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.599380] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.599519] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 is going to be updated. [ 1262.619885] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.620121] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.620257] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.620518] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.620723] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.620971] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.994672] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1262.994868] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.325700] env[66157]: INFO networking_nsxv3.common.synchronization [req-3cd0bf30-4d85-4090-8e85-a02253ac21e3 req-4cbdfb08-13eb-40e6-84e8-af3aae521ef9 service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1263.325700] env[66157]: INFO networking_nsxv3.common.synchronization [req-3cd0bf30-4d85-4090-8e85-a02253ac21e3 req-4cbdfb08-13eb-40e6-84e8-af3aae521ef9 service nova] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1263.325700] env[66157]: INFO networking_nsxv3.common.synchronization [req-3cd0bf30-4d85-4090-8e85-a02253ac21e3 req-4cbdfb08-13eb-40e6-84e8-af3aae521ef9 service nova] Enqueued Resource ID: d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 with Priority: HIGHEST for action port [ 1263.325700] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_rules [ 1263.325700] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1263.325700] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 with Priority: HIGHEST for action port [ 1263.325700] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.325931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.325931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.326065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.326149] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.327519] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.327519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.327758] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.327838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.327971] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.328080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.328134] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.328282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.328369] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.328540] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.329323] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.329430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.329496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.329648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.329723] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fa8eac-6f23-48a0-b060-7bcfdafae0a8',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.831689] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.832070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.832070] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.833221] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 with status ACTIVE [ 1263.833415] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.833547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.833623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.833884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.833990] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.834194] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.834325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.834400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.834558] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.834644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.834835] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.834929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.834989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.835627] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.835723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.835809] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6fa8eac-6f23-48a0-b060-7bcfdafae0a8 is going to be updated. [ 1263.859197] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.859383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.859383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.859646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.859815] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.859981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6fa8eac-6f23-48a0-b060-7bcfdafae0a8" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.338377] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.841324] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.841636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.841636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.841763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.841853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.841955] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1264.872272] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.872463] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.872521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.872762] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.872920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.882527] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1265.027125] env[66157]: INFO networking_nsxv3.common.synchronization [req-c350df53-61fb-477d-93f8-7b6729723d90 req-f9c12ce5-981f-43c3-b031-5429c3c4980b tempest-ServerActionsTestOtherB-552517833 tempest-ServerActionsTestOtherB-552517833-project-member] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1265.027426] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1265.027723] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.027835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.027898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.029041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.029041] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.029041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.029041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.029041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.029041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.029041] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.324847] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.325083] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.326493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.326493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.326493] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.326493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.326493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.326493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.326493] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.326948] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1265.326948] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1265.326948] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1265.327060] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1265.327143] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1265.327231] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1265.327360] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1265.347519] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1265.347519] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1265.347854] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1265.348020] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.348351] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-163823ec-1e88-455f-a911-64b1ff11ec13 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.349025] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-163823ec-1e88-455f-a911-64b1ff11ec13" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.349025] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-163823ec-1e88-455f-a911-64b1ff11ec13" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.349025] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-163823ec-1e88-455f-a911-64b1ff11ec13" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.349191] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('163823ec-1e88-455f-a911-64b1ff11ec13',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.531183] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.531390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.531506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.531859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.532026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.532276] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.532409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.532476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.532645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.532724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.532809] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1265.557770] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.558052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.558052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.558196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.558339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.567702] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1265.851538] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.851898] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.851898] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.852250] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.852384] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.852539] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 163823ec-1e88-455f-a911-64b1ff11ec13 not found, creating... [ 1265.852799] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.852952] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.853089] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.853302] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.853439] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.853716] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.853951] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.854091] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.854319] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.854458] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.854606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 163823ec-1e88-455f-a911-64b1ff11ec13 is going to be created. [ 1265.875361] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.875742] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.875742] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.876041] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.876385] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.876724] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-163823ec-1e88-455f-a911-64b1ff11ec13" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.591973] env[66157]: INFO networking_nsxv3.common.synchronization [req-c350df53-61fb-477d-93f8-7b6729723d90 req-53959e51-46bb-454e-a6c2-7de1edebe1ec service nova] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1266.592173] env[66157]: INFO networking_nsxv3.common.synchronization [req-c350df53-61fb-477d-93f8-7b6729723d90 req-53959e51-46bb-454e-a6c2-7de1edebe1ec service nova] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1266.592428] env[66157]: INFO networking_nsxv3.common.synchronization [req-c350df53-61fb-477d-93f8-7b6729723d90 req-53959e51-46bb-454e-a6c2-7de1edebe1ec service nova] Enqueued Resource ID: 163823ec-1e88-455f-a911-64b1ff11ec13 with Priority: HIGHEST for action port [ 1266.592993] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1266.593150] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1266.593251] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 163823ec-1e88-455f-a911-64b1ff11ec13 with Priority: HIGHEST for action port [ 1266.593538] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.593660] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.593741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.593921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.594009] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.595211] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.595312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.595529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-163823ec-1e88-455f-a911-64b1ff11ec13 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.595641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-163823ec-1e88-455f-a911-64b1ff11ec13" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.595706] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-163823ec-1e88-455f-a911-64b1ff11ec13" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.596277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-163823ec-1e88-455f-a911-64b1ff11ec13" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.596277] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('163823ec-1e88-455f-a911-64b1ff11ec13',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.894336] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1266.894781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.894781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.894938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.895109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.895234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.895305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.895439] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.895523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.895583] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.895674] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.097972] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.098270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.098270] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 163823ec-1e88-455f-a911-64b1ff11ec13 with status ACTIVE [ 1267.098443] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.098550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.098618] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.098837] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.098913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.099112] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.099187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.099248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.099393] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.099494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.099766] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.099913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.100026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.100178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.100253] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.100339] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 163823ec-1e88-455f-a911-64b1ff11ec13 is going to be updated. [ 1267.121268] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.121450] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.121507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.121670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.121809] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.121968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-163823ec-1e88-455f-a911-64b1ff11ec13" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.290512] env[66157]: INFO networking_nsxv3.common.synchronization [req-fa57bad2-b974-4887-8981-538749f95380 req-1fcbe7dd-7fc1-4f4f-ba7d-51fc8741eed5 tempest-AttachVolumeTestJSON-1599628970 tempest-AttachVolumeTestJSON-1599628970-project-member] Enqueued Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_members [ 1267.290678] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_members [ 1267.290989] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.291129] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.291195] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.291436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.291592] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.291692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.291753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.291906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.291991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.292109] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.397866] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.398014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.398014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.400030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.400030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.400030] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.400030] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.400030] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.577953] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1267.578318] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a deletion is rescheduled due to dependency. [ 1267.578318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.578488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.578678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.578859] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.578973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.579051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.579201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.579282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.579384] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.595085] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.595344] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.595491] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.595748] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.596022] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.596174] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.596289] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.596509] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.596718] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.596943] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1267.597072] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1267.597180] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1267.597284] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1267.597417] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1267.597493] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1267.597619] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1267.616346] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1267.616535] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1267.616687] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1267.616884] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-211" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.617300] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-944648da-cd74-49aa-aa71-7a444d1a748d taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.617476] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-944648da-cd74-49aa-aa71-7a444d1a748d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.617596] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-944648da-cd74-49aa-aa71-7a444d1a748d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.617904] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-944648da-cd74-49aa-aa71-7a444d1a748d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.618050] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944648da-cd74-49aa-aa71-7a444d1a748d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.795763] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.795763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.795763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.795947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.796052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.796257] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.796350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.796403] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.796549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.796621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.796704] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a11d247-5b58-4309-be42-e273703c703a already deleted. [ 1267.796808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.903072] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fec754f5-f737-48ef-9255-9d4bc7df0c2e: rpc.has_security_group_logging(os_id): False [ 1267.928887] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.929099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.929099] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.929314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.929405] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.930042] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.930042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.930042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.930042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.930042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.930385] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.930385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.930385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.930794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.930794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.930794] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.930794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.930951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.930985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.931074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.931163] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1267.998612] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.998829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.998829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.999056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.999226] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.015516] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1268.081313] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.121123] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.121123] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.121123] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.121412] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.121412] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.121545] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 944648da-cd74-49aa-aa71-7a444d1a748d not found, creating... [ 1268.121803] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.121964] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.122102] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.122329] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.122486] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.122784] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.122928] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.123056] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.123265] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.123398] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.123536] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 944648da-cd74-49aa-aa71-7a444d1a748d is going to be created. [ 1268.145435] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.145728] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.145728] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.145968] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.146224] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.146442] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-944648da-cd74-49aa-aa71-7a444d1a748d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.584890] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.884414] env[66157]: INFO networking_nsxv3.common.synchronization [req-fa57bad2-b974-4887-8981-538749f95380 req-ad045724-c79f-4b3d-9dbb-5bc2cb9b2057 service nova] Enqueued Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_rules [ 1268.884414] env[66157]: INFO networking_nsxv3.common.synchronization [req-fa57bad2-b974-4887-8981-538749f95380 req-ad045724-c79f-4b3d-9dbb-5bc2cb9b2057 service nova] Enqueued Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_members [ 1268.884558] env[66157]: INFO networking_nsxv3.common.synchronization [req-fa57bad2-b974-4887-8981-538749f95380 req-ad045724-c79f-4b3d-9dbb-5bc2cb9b2057 service nova] Enqueued Resource ID: 944648da-cd74-49aa-aa71-7a444d1a748d with Priority: HIGHEST for action port [ 1268.885109] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_rules [ 1268.885243] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_members [ 1268.885358] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 944648da-cd74-49aa-aa71-7a444d1a748d with Priority: HIGHEST for action port [ 1268.885658] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.885772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.885845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.886081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.886136] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.886968] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.887096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.887151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.887317] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.887457] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.887550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.887606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.887749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.887857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.887919] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.888685] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-944648da-cd74-49aa-aa71-7a444d1a748d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.889712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-944648da-cd74-49aa-aa71-7a444d1a748d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.889712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-944648da-cd74-49aa-aa71-7a444d1a748d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.889712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-944648da-cd74-49aa-aa71-7a444d1a748d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.889962] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944648da-cd74-49aa-aa71-7a444d1a748d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.088073] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.088073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.088073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.088073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.088705] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.088705] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1269.114708] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.114927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.114927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.115132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.115259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.123986] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1269.392491] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.392724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.392830] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.393776] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 944648da-cd74-49aa-aa71-7a444d1a748d with status ACTIVE [ 1269.393972] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.394096] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.394162] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.394392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.395024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.395024] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.395024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.395024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.395024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.395024] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.395330] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.395330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.395330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.395453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.395527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.395611] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 944648da-cd74-49aa-aa71-7a444d1a748d is going to be updated. [ 1269.416431] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.416607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.416607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.416790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.416922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.417093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-944648da-cd74-49aa-aa71-7a444d1a748d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.897373] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.031067] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1270.031296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.399431] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.399794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.399794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.399870] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.399963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.400077] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a11d247-5b58-4309-be42-e273703c703a is going to be created. [ 1270.426467] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.426681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.426681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.426857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.427022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.436492] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: UNINITIALIZED for 2s [ 1271.133702] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1271.133932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.134118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.134424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.134681] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.134764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.134836] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.134986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.135080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.135165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.135253] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.637212] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.141105] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 612116dc-6e5d-4737-93ca-c21312262c3a: rpc.has_security_group_logging(os_id): False [ 1272.157985] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.158192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.158192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.158410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.158553] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.158843] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.158915] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.158966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.159167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.159285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.159382] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1272.216668] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.216851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.216900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.217102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.217250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.229228] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1272.446787] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: SUCCESS [ 1272.446997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.447191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.447417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.447607] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.447720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.447795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.447932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.448020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.448116] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.448206] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.951692] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.456170] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a11d247-5b58-4309-be42-e273703c703a: rpc.has_security_group_logging(os_id): False [ 1273.492712] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.492937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.492937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.493196] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.493289] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.493585] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.493708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.493747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.493877] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.493952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.494061] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a11d247-5b58-4309-be42-e273703c703a is going to be created. [ 1273.557330] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.557597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.557597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.557811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.557995] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.570571] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: IN_PROGRESS for 2s [ 1273.886500] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1273.886720] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1274.241742] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1274.242090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.592396] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: SUCCESS [ 1275.592760] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.888281] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1278.888281] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1279.415096] env[66157]: INFO networking_nsxv3.common.synchronization [req-6d23c14c-5c63-4b5b-a0f8-b8970a13a9ca req-31f7a469-cd8d-4e49-b513-6b481a3752b0 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1279.415848] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1279.415950] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.416034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.416076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.416309] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.416425] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.416521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.416582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.416728] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.416839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.416930] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.918704] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.420719] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.922853] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.923281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.923281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.923455] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.923559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.923681] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46786056-6b70-4ba1-a412-a7042077532f is going to be updated. [ 1280.953717] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.953932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.953981] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.954216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.954366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.962964] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: IN_PROGRESS for 2s [ 1282.974705] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: SUCCESS [ 1282.975131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.416650] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.417130] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.554847] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1285.555228] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:3 started [ 1286.301864] env[66157]: INFO networking_nsxv3.common.synchronization [req-ec435402-a5ae-4f7a-a0e7-ee29a7259848 req-dae57f2a-bee3-4efd-ab1a-b2e816ea8a4c tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1286.302626] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGHEST for action security_group_members [ 1286.303047] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.303204] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.303279] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.303465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.303621] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.303739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.303798] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.303948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.304045] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.304137] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.807068] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.807493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.807493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.807582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.807617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.807797] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.807935] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.807986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.808124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.808234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.808283] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46786056-6b70-4ba1-a412-a7042077532f is going to be updated. [ 1286.837270] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.837480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.837480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.837671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.837821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.847358] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: IN_PROGRESS for 2s [ 1288.858279] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46786056-6b70-4ba1-a412-a7042077532f in Status: SUCCESS [ 1288.858647] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46786056-6b70-4ba1-a412-a7042077532f deletion is rescheduled due to dependency. [ 1288.858647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.706944] env[66157]: INFO networking_nsxv3.common.synchronization [None req-60bdb8fc-0952-4f30-9369-4c5b6ed8b5f9 tempest-AttachInterfacesTestJSON-1787533123 tempest-AttachInterfacesTestJSON-1787533123-project-member] Enqueued Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1290.707212] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e with Priority: HIGHEST for action security_group_members [ 1290.707500] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-fec754f5-f737-48ef-9255-9d4bc7df0c2e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.707614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.707685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.707834] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.707990] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.708108] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.708165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.708316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.708401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.708493] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fec754f5-f737-48ef-9255-9d4bc7df0c2e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.211051] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.211051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.211051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.211338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.211338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.211545] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.211651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.211714] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.211876] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.211954] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.212052] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e is going to be updated. [ 1291.241639] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.241784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.241852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.242070] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.242212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.250634] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: IN_PROGRESS for 2s [ 1293.261114] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e in Status: SUCCESS [ 1293.261354] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fec754f5-f737-48ef-9255-9d4bc7df0c2e deletion is rescheduled due to dependency. [ 1293.261395] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fec754f5-f737-48ef-9255-9d4bc7df0c2e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.556524] env[66157]: INFO networking_nsxv3.common.synchronization [None req-5b73ac9d-dbc0-452e-9e43-4a52c070890a None None] Enqueued Resource ID: 1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e with Priority: HIGHEST for action port [ 1294.557162] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e with Priority: HIGHEST for action port [ 1294.557477] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.557597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.557665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.557912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.558018] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.061807] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e [ 1295.061807] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.061807] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.062051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.062091] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.062165] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.062264] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e already deleted. [ 1295.062344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fb8d6a6-1090-4f8c-967a-3c7703ebfc6e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.161417] env[66157]: INFO networking_nsxv3.common.synchronization [None req-b58067cb-9320-4a7c-8ad1-1b60248a81e7 tempest-ServersTestBootFromVolume-544437522 tempest-ServersTestBootFromVolume-544437522-project-member] Enqueued Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_rules [ 1295.161938] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_rules [ 1295.162271] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506c0ef8-aa46-420a-8a0a-fede11258a2b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.163041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.163041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.163041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.163041] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.244761] env[66157]: INFO networking_nsxv3.common.synchronization [None req-362dc8d4-8c31-4def-af36-cc13424102c8 tempest-ServersTestBootFromVolume-544437522 tempest-ServersTestBootFromVolume-544437522-project-member] Enqueued Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_rules [ 1295.245295] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_rules [ 1295.245659] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506c0ef8-aa46-420a-8a0a-fede11258a2b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.245985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.685274] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.685545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.685545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.685808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.685950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.686072] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b already deleted. [ 1295.686166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.686331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.686507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.686596] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.209022] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.209022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.209022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.209022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.209245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.209245] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b already deleted. [ 1296.209245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.765098] env[66157]: INFO networking_nsxv3.common.synchronization [None req-90e64cf9-c706-4b76-be8f-c02c00574fbf None None] Enqueued Resource ID: bb61b785-38dc-4881-8505-e09018a0c06e with Priority: HIGHEST for action port [ 1296.765658] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb61b785-38dc-4881-8505-e09018a0c06e with Priority: HIGHEST for action port [ 1296.765980] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb61b785-38dc-4881-8505-e09018a0c06e taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.766112] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb61b785-38dc-4881-8505-e09018a0c06e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.766182] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb61b785-38dc-4881-8505-e09018a0c06e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.766433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb61b785-38dc-4881-8505-e09018a0c06e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.766518] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb61b785-38dc-4881-8505-e09018a0c06e',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.268736] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb61b785-38dc-4881-8505-e09018a0c06e [ 1297.268979] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.269186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.269186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.269399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.269492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.269589] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb61b785-38dc-4881-8505-e09018a0c06e already deleted. [ 1297.269670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb61b785-38dc-4881-8505-e09018a0c06e" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.766810] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.767246] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.582793] env[66157]: INFO networking_nsxv3.common.synchronization [req-13b73d3a-514c-4c1e-8452-3b67a30fb1bb req-0dade206-a108-4ff9-b429-bfd6ee5f0a8f tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 1305.583393] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 1305.583735] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.583927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.583927] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.584155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.584312] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.584412] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.584473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.584624] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.584753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.584859] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.087656] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.589735] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.092449] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.092691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.092691] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.092937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.093050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.093159] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 is going to be updated. [ 1307.122966] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.123199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.123199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.123419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.123531] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.131495] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: IN_PROGRESS for 2s [ 1309.143601] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: SUCCESS [ 1309.143985] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.584942] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.585382] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.586037] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.586806] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1316.868839] env[66157]: INFO networking_nsxv3.common.synchronization [req-6d2e4910-dc77-4b4b-bc2a-7a24fed7f925 req-baa4f675-4a9d-4e32-b060-ddf67073fb29 tempest-ServerActionsTestJSON-962935349 tempest-ServerActionsTestJSON-962935349-project-member] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1316.869394] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGHEST for action security_group_members [ 1316.869699] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.869821] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.869911] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.870107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.870262] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.870374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.870442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.870592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.870695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.870787] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.373544] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.373744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.373744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.374094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.374210] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.374415] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.374516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.374576] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.374736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.374812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.374925] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be updated. [ 1317.401696] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.402020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.402020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.402203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.402260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.411015] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: IN_PROGRESS for 2s [ 1319.421366] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 in Status: SUCCESS [ 1319.421721] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 deletion is rescheduled due to dependency. [ 1319.421721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.689982] env[66157]: INFO networking_nsxv3.common.synchronization [req-24161058-9e76-4854-b35b-2c3260b789fc req-c61dd7fa-614f-431a-b1f5-9773483ae200 tempest-ServersTestBootFromVolume-544437522 tempest-ServersTestBootFromVolume-544437522-project-member] Enqueued Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_members [ 1319.690557] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_members [ 1319.690868] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-506c0ef8-aa46-420a-8a0a-fede11258a2b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.691020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.691102] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.691355] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.691529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.691630] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.691694] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.691838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.691924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.692031] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.019887] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.020217] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-842" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.020342] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-842" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.020726] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-842" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.021043] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.021300] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.021466] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.021726] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.021880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.022116] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1320.022248] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1320.022380] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1320.022488] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1320.022618] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1320.022821] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1320.023011] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1320.043957] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1320.044177] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1320.044339] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1320.044556] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-842" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.044909] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.046111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.046111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.046111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.046111] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.194357] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.194582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.194582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.194808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.194897] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.195174] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.195290] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.195353] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.195516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.195595] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.195695] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b already deleted. [ 1320.195778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.548242] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.548659] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.548659] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.548837] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.548979] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.549145] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port 3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7 not found, creating... [ 1320.549406] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.549556] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.549672] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.549877] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.550040] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.550325] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.550475] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.550596] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.550793] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.550923] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.551071] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7 is going to be created. [ 1320.572321] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.572539] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.572589] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.572874] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.573127] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.573371] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.272958] env[66157]: INFO networking_nsxv3.common.synchronization [req-24161058-9e76-4854-b35b-2c3260b789fc req-b755d080-73ea-47ac-98c9-be43669289d5 service nova] Enqueued Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_rules [ 1321.273142] env[66157]: INFO networking_nsxv3.common.synchronization [req-24161058-9e76-4854-b35b-2c3260b789fc req-b755d080-73ea-47ac-98c9-be43669289d5 service nova] Enqueued Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_members [ 1321.273283] env[66157]: INFO networking_nsxv3.common.synchronization [req-24161058-9e76-4854-b35b-2c3260b789fc req-b755d080-73ea-47ac-98c9-be43669289d5 service nova] Enqueued Resource ID: 3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7 with Priority: HIGHEST for action port [ 1321.274094] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_rules [ 1321.274305] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_members [ 1321.274450] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7 with Priority: HIGHEST for action port [ 1321.274768] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506c0ef8-aa46-420a-8a0a-fede11258a2b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.274929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.275050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.275285] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.275411] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.276448] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-506c0ef8-aa46-420a-8a0a-fede11258a2b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.276612] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.276713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.276914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.277126] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.277270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.278125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.278358] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.278488] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.278673] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.279610] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.279757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.279853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.280328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.280328] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.782374] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-506c0ef8-aa46-420a-8a0a-fede11258a2b taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.782786] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.782786] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.784197] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7 with status ACTIVE [ 1321.784522] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.785087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.785087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.785259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.785325] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.785593] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.785757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.785839] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.786158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.786222] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.786559] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.786695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.786867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.787151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.787287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.787418] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7 is going to be updated. [ 1321.810072] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.810072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.810072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.810072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.810574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.810574] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e9650a5-53d2-4a3d-8ab8-e0eff6ee22f7" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.289851] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.496985] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.497212] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.497259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.497492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.497609] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.793292] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.793292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.793292] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.793579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.793579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.793579] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b is going to be created. [ 1322.828684] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.828906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.829077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.829626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.829675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.842305] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b in Status: UNINITIALIZED for 2s [ 1323.000579] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.066892] env[66157]: INFO networking_nsxv3.common.synchronization [req-53f9c6c5-eb85-4b37-b389-d7f2cbb4a2fc req-760372c8-13b1-4806-baba-b278903065d1 tempest-ServerActionsTestOtherA-503848347 tempest-ServerActionsTestOtherA-503848347-project-member] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 1323.067526] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGHEST for action security_group_members [ 1323.067772] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.067890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.067950] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.068228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.068293] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.068411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.068458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.068586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.068673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.068753] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.502888] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.572356] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.572356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.572495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.572695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.572789] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.572987] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.573093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.573179] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.573298] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.573372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.573460] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 is going to be updated. [ 1323.605743] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.605893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.605977] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.607186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.607380] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.619745] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: IN_PROGRESS for 2s [ 1324.005332] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1324.005615] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1324.867571] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b in Status: SUCCESS [ 1324.867818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.868100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.868314] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.868624] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.868696] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.868736] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.868887] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.868967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.869075] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.869166] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.048439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.048768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.048768] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.048849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.062933] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1325.063882] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.065145] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1325.106606] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.106764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.106829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.107051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.121641] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.123041] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1325.123041] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1325.123041] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1325.174367] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.174367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.174367] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.174587] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.175853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.176074] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1325.265036] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.265217] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.265304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.265713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.265859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.266377] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1325.349098] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.349299] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.349342] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.349547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.349894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.350242] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1325.350337] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'af1b6b4a-f6fc-4455-852a-7c4e38106c56', '9a11d247-5b58-4309-be42-e273703c703a', '2a3d86b0-5e47-4031-aa77-b1a917545a8b', '46786056-6b70-4ba1-a412-a7042077532f', '00106a4a-ef70-4397-a8b9-afffa44e977b', '16ef380f-fc6a-4b09-a172-185ed835a4be', 'b6a87886-c2f5-4505-92ee-9c2a202b7b93', '2381db7b-1b29-4dfc-a6af-48c498e3e0b0', '612116dc-6e5d-4737-93ca-c21312262c3a', 'b5b02819-f659-4343-b709-2e63116c5829', '68270d8f-ab80-474f-8966-489611b2e965', '9bed370b-5a4e-4e78-98e5-e98e33a5c46a', '9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94', '413d37d4-0b94-44d0-aa20-20a2f41994ba', 'dbe07656-65ae-471b-953b-0e7810aed7b9', '4120ed87-fb96-4685-aabd-90a91df342cd', '62b70f12-d63b-40fb-b48e-a611590fad1f', 'fc8d54c1-30b0-4581-9d61-8b194199903c', '222383c0-b19b-4725-af40-286f27465c68', 'cd4d34e1-d4d8-4980-86c7-3c5c3b76571b', '58626db2-1bef-478d-8fe6-5cb88f964fa3', 'c4915dbf-d6e2-46dd-8508-11f50b8da0ef', '099cf4d4-ded3-44df-b6e7-328bc3763be6', '7a251e98-2d26-4017-96a0-c67e8ea7efc0', 'd99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d', '047471a8-6f49-4481-a53f-c45f9c23e798', '6b93b3d3-7a24-441f-88d0-38d5293ec145', '4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1', '8a39b75b-de15-457f-a080-b14841d7ea90', '7b48ccef-7f9a-4d48-8b46-294031485bbd', 'd46b1e4e-446b-4001-9e14-1ab5b40a8087', '21980f25-eb0b-4647-8b51-f835b6f941ea', '8cb67253-fbd5-4c41-8d67-3b3c6d1bc719', '1ed4675f-1916-4e79-b525-fb7797e97825', '4bb5a370-76e0-4d7c-9a46-84239200c704', 'd5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24', '1dae1e84-05f3-49da-b3a4-8d3f4e788988', 'fec754f5-f737-48ef-9255-9d4bc7df0c2e', 'a38d5e1a-6785-4c65-98b8-9c43e55d070c'} {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1325.350435] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1325.371300] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.374521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.374702] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.374823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.375606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.375606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.375606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1325.375606] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1325.375606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1325.459058] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.459190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.459257] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.459478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.460610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.460900] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1325.460978] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1325.461065] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1325.461134] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1325.461216] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 1325.461290] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGH for action security_group_rules [ 1325.461421] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGH for action security_group_rules [ 1325.461421] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGH for action security_group_rules [ 1325.461497] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGH for action security_group_rules [ 1325.461539] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGH for action security_group_rules [ 1325.461601] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGH for action security_group_rules [ 1325.461662] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGH for action security_group_rules [ 1325.461722] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGH for action security_group_rules [ 1325.461783] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGH for action security_group_rules [ 1325.461844] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGH for action security_group_rules [ 1325.461905] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGH for action security_group_rules [ 1325.461967] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGH for action security_group_rules [ 1325.462038] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGH for action security_group_rules [ 1325.462105] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGH for action security_group_rules [ 1325.462167] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGH for action security_group_rules [ 1325.462229] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGH for action security_group_rules [ 1325.462292] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGH for action security_group_rules [ 1325.462357] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGH for action security_group_rules [ 1325.462419] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGH for action security_group_rules [ 1325.462480] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGH for action security_group_rules [ 1325.462577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.639527] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 in Status: SUCCESS [ 1325.639728] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 deletion is rescheduled due to dependency. [ 1325.639851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.877654] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 506c0ef8-aa46-420a-8a0a-fede11258a2b: rpc.has_security_group_logging(os_id): False [ 1325.899709] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.899952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.899952] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.900170] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.900260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.900547] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.900656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.900722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.900890] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.900973] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.901042] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b is going to be created. [ 1325.965366] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.965662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.965662] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.965956] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.966209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.980502] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b in Status: IN_PROGRESS for 2s [ 1327.832952] env[66157]: INFO networking_nsxv3.common.synchronization [None req-51fcd7fa-aff0-4242-afc0-1fd4ea85d3e0 None None] Enqueued Resource ID: 245a973a-a4a7-4aa5-a3a9-2500a4ae77cc with Priority: HIGHEST for action port [ 1327.833205] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245a973a-a4a7-4aa5-a3a9-2500a4ae77cc with Priority: HIGHEST for action port [ 1327.833332] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 with Priority: HIGH for action security_group_rules [ 1327.833438] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b with Priority: HIGH for action security_group_rules [ 1327.833530] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 with Priority: HIGH for action security_group_rules [ 1327.833627] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe07656-65ae-471b-953b-0e7810aed7b9 with Priority: HIGH for action security_group_rules [ 1327.835660] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b with Priority: HIGH for action security_group_rules [ 1327.835924] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222383c0-b19b-4725-af40-286f27465c68 with Priority: HIGH for action security_group_rules [ 1327.836156] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8d54c1-30b0-4581-9d61-8b194199903c with Priority: HIGH for action security_group_rules [ 1327.836296] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b70f12-d63b-40fb-b48e-a611590fad1f with Priority: HIGH for action security_group_rules [ 1327.836716] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba with Priority: HIGH for action security_group_rules [ 1327.837077] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4120ed87-fb96-4685-aabd-90a91df342cd with Priority: HIGH for action security_group_rules [ 1327.837411] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 with Priority: HIGH for action security_group_rules [ 1327.837568] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a with Priority: HIGH for action security_group_rules [ 1327.837678] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68270d8f-ab80-474f-8966-489611b2e965 with Priority: HIGH for action security_group_rules [ 1327.838101] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b02819-f659-4343-b709-2e63116c5829 with Priority: HIGH for action security_group_rules [ 1327.838263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGH for action security_group_rules [ 1327.838935] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ef380f-fc6a-4b09-a172-185ed835a4be with Priority: HIGH for action security_group_rules [ 1327.838935] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 with Priority: HIGH for action security_group_rules [ 1327.839219] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00106a4a-ef70-4397-a8b9-afffa44e977b with Priority: HIGH for action security_group_rules [ 1327.839305] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGH for action security_group_rules [ 1327.839440] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46786056-6b70-4ba1-a412-a7042077532f with Priority: HIGH for action security_group_rules [ 1327.840113] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-245a973a-a4a7-4aa5-a3a9-2500a4ae77cc taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.840113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-245a973a-a4a7-4aa5-a3a9-2500a4ae77cc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.840113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-245a973a-a4a7-4aa5-a3a9-2500a4ae77cc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.840351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-245a973a-a4a7-4aa5-a3a9-2500a4ae77cc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.840478] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('245a973a-a4a7-4aa5-a3a9-2500a4ae77cc',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.844029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.844029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.844029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.844029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.844621] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1b6b4a-f6fc-4455-852a-7c4e38106c56',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.845733] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.845733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.845733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.845733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.846067] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a3d86b0-5e47-4031-aa77-b1a917545a8b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.847857] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.847857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.847857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.847857] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.847857] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a87886-c2f5-4505-92ee-9c2a202b7b93',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.849989] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe07656-65ae-471b-953b-0e7810aed7b9 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.849989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.849989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.849989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.849989] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe07656-65ae-471b-953b-0e7810aed7b9',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.850439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.850533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.850600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.851735] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.851938] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd4d34e1-d4d8-4980-86c7-3c5c3b76571b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.854119] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-222383c0-b19b-4725-af40-286f27465c68 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.854252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.854301] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.854461] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.854530] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('222383c0-b19b-4725-af40-286f27465c68',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.855340] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc8d54c1-30b0-4581-9d61-8b194199903c taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.855442] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.855506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.856167] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.856167] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc8d54c1-30b0-4581-9d61-8b194199903c',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.858059] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62b70f12-d63b-40fb-b48e-a611590fad1f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.858221] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.858438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.858438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.858647] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62b70f12-d63b-40fb-b48e-a611590fad1f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.859304] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-413d37d4-0b94-44d0-aa20-20a2f41994ba taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.859552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.859658] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.859853] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.859946] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('413d37d4-0b94-44d0-aa20-20a2f41994ba',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.860761] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4120ed87-fb96-4685-aabd-90a91df342cd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.860863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.860863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.861111] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.861111] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4120ed87-fb96-4685-aabd-90a91df342cd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.861796] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.861939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.862032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.862142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.862404] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.862951] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.863554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.863554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.863554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.863554] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bed370b-5a4e-4e78-98e5-e98e33a5c46a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.864329] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68270d8f-ab80-474f-8966-489611b2e965 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.864329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.864484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.864544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.864613] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68270d8f-ab80-474f-8966-489611b2e965',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.865928] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b02819-f659-4343-b709-2e63116c5829 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.865928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.865928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.865928] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.865928] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b02819-f659-4343-b709-2e63116c5829',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.866396] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.866493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.866493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.866615] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.866677] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.869151] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16ef380f-fc6a-4b09-a172-185ed835a4be taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.869151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.869151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.869151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.869151] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16ef380f-fc6a-4b09-a172-185ed835a4be',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.869151] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.869151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.869151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.869151] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.869151] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2381db7b-1b29-4dfc-a6af-48c498e3e0b0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.870160] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00106a4a-ef70-4397-a8b9-afffa44e977b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.870160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.870160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.870160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.870160] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00106a4a-ef70-4397-a8b9-afffa44e977b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.870822] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.870822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.870822] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.871220] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.871220] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.871957] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46786056-6b70-4ba1-a412-a7042077532f taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.872148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.872148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.872475] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.872475] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46786056-6b70-4ba1-a412-a7042077532f',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.895892] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.897316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.897429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.898015] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.953090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.953090] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a3d86b0-5e47-4031-aa77-b1a917545a8b is going to be deleted. [ 1327.993371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b in Status: SUCCESS [ 1327.995026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.021964] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.022156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.022205] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.023072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.023072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.023072] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a3d86b0-5e47-4031-aa77-b1a917545a8b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.322110] env[66157]: INFO networking_nsxv3.common.synchronization [None req-9a34f6ac-ea0d-4b08-8dc7-6c70ce4e95eb tempest-AttachVolumeShelveTestJSON-1165064594 tempest-AttachVolumeShelveTestJSON-1165064594-project-member] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_rules [ 1328.322657] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_rules [ 1328.323082] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.323219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.323219] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.323481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.323588] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.376753] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.376753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.376753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.376753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.376753] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.376753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.376753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.376753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.376753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.376753] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.376753] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.384851] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 245a973a-a4a7-4aa5-a3a9-2500a4ae77cc [ 1328.384851] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.384851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.384851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.385156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.385156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.385245] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:245a973a-a4a7-4aa5-a3a9-2500a4ae77cc already deleted. [ 1328.386017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-245a973a-a4a7-4aa5-a3a9-2500a4ae77cc" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.386636] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.386749] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.386812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.386970] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.387115] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.387201] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.387262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.387419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.387517] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.387621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.387709] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.419215] env[66157]: INFO networking_nsxv3.common.synchronization [None req-713bceae-7ae9-4163-8850-e5a9a6e2b2cf tempest-AttachVolumeShelveTestJSON-1165064594 tempest-AttachVolumeShelveTestJSON-1165064594-project-member] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_rules [ 1328.433753] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_rules [ 1328.446096] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.446291] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.446404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.446507] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.449595] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.449759] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.452241] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.452390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.453224] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.453425] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.454091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.454186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.455643] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.455731] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.456544] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.456701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.457458] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.457619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.458307] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.458399] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.459787] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.459787] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.461892] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.462028] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.462761] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.462856] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.465050] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.465544] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.465655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.466609] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.467054] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.467166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.467828] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.468267] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.468356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.468978] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.469511] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.469620] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.470631] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.471015] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.471133] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.471843] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.472253] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.472370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.473134] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.473570] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.473732] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b02819-f659-4343-b709-2e63116c5829 is going to be deleted. [ 1328.474803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.475149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.494094] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.494235] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413d37d4-0b94-44d0-aa20-20a2f41994ba is going to be deleted. [ 1328.495322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.495530] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.518274] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.518413] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16ef380f-fc6a-4b09-a172-185ed835a4be is going to be deleted. [ 1328.519458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.519712] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.544438] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.544555] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.546924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.547060] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bed370b-5a4e-4e78-98e5-e98e33a5c46a is going to be deleted. [ 1328.547946] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.548191] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.549678] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.550339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.566473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.566622] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4120ed87-fb96-4685-aabd-90a91df342cd is going to be deleted. [ 1328.568875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.568875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.576604] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.576788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.586697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.586844] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94 is going to be deleted. [ 1328.588678] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.589521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.610937] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.611101] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1b6b4a-f6fc-4455-852a-7c4e38106c56 is going to be deleted. [ 1328.612046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.612259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.635062] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.635198] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.658689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.658829] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc8d54c1-30b0-4581-9d61-8b194199903c is going to be deleted. [ 1328.659885] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.660150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.663063] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.663063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.696920] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.697101] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.717245] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.717395] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 222383c0-b19b-4725-af40-286f27465c68 is going to be deleted. [ 1328.719090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.719090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.757913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.757913] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62b70f12-d63b-40fb-b48e-a611590fad1f is going to be deleted. [ 1328.760554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.760554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.761338] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.761496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.832178] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.832429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.834092] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.834350] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68270d8f-ab80-474f-8966-489611b2e965 is going to be deleted. [ 1328.835389] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.835614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.865321] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.865596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.872168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.872356] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46786056-6b70-4ba1-a412-a7042077532f is going to be deleted. [ 1328.873401] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.873623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.875581] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.875700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.883801] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.907051] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.913278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.913423] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd4d34e1-d4d8-4980-86c7-3c5c3b76571b is going to be deleted. [ 1328.914898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.915056] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.936553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.936688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.945324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.945468] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe07656-65ae-471b-953b-0e7810aed7b9 is going to be deleted. [ 1328.946588] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.947154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.955178] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.955335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.013552] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.013700] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2381db7b-1b29-4dfc-a6af-48c498e3e0b0 is going to be deleted. [ 1329.014929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.014929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.021460] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.021582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.058091] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.058261] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.086067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.086251] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00106a4a-ef70-4397-a8b9-afffa44e977b is going to be deleted. [ 1329.087141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.087362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.121744] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.121829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.124139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.124139] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a87886-c2f5-4505-92ee-9c2a202b7b93 is going to be deleted. [ 1329.124139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.124139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.124296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.124484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b02819-f659-4343-b709-2e63116c5829" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.124628] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.124922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.124922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.125085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-413d37d4-0b94-44d0-aa20-20a2f41994ba" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.125879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.125879] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.126093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.126452] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16ef380f-fc6a-4b09-a172-185ed835a4be" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.126764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.127052] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.127190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.127713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bed370b-5a4e-4e78-98e5-e98e33a5c46a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.127878] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.128077] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.128155] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.128277] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4120ed87-fb96-4685-aabd-90a91df342cd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.128409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.128579] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.128723] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.128855] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cbf6e0c-f2fe-4234-9d44-02dda9cf2f94" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.128983] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.129244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.129319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.129449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1b6b4a-f6fc-4455-852a-7c4e38106c56" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.129566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.129701] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.129775] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.129892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc8d54c1-30b0-4581-9d61-8b194199903c" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.130027] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.130166] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.130241] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.130337] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 already deleted. [ 1329.130416] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.130539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.130673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.130747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.130858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-222383c0-b19b-4725-af40-286f27465c68" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.130965] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.131137] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.131223] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.132103] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.132264] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.132345] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.133050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68270d8f-ab80-474f-8966-489611b2e965" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.133171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.133268] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.133351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.133469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62b70f12-d63b-40fb-b48e-a611590fad1f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.134107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.134107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.134107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.134107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd4d34e1-d4d8-4980-86c7-3c5c3b76571b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.134107] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.134428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.134428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.134428] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46786056-6b70-4ba1-a412-a7042077532f" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.134562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.134647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.134680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.134794] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe07656-65ae-471b-953b-0e7810aed7b9" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.219715] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.219926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.220029] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.220266] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.220361] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.220483] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2381db7b-1b29-4dfc-a6af-48c498e3e0b0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.227896] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.228143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.228143] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.228370] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.228421] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.228501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00106a4a-ef70-4397-a8b9-afffa44e977b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.315466] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.315466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.315466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.316610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.316610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.316610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a87886-c2f5-4505-92ee-9c2a202b7b93" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.388811] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a11d247-5b58-4309-be42-e273703c703a: rpc.has_security_group_logging(os_id): False [ 1329.409691] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 612116dc-6e5d-4737-93ca-c21312262c3a: rpc.has_security_group_logging(os_id): False [ 1329.437700] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.437880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.437924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.438158] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.451099] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.451282] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.470913] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.471363] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.471493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.471493] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.471675] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.471777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.471863] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a11d247-5b58-4309-be42-e273703c703a is going to be updated. [ 1329.473020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.473249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.508478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.509187] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.509187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.509187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.509187] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.509404] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.509404] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1329.563495] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.563644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.563734] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.564214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.564214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.579490] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: IN_PROGRESS for 2s [ 1329.590202] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.591433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.591433] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.591647] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.593035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.608382] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1329.677424] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.677838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.677838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.678228] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.678516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.678658] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 already deleted. [ 1329.678764] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.352686] env[66157]: INFO networking_nsxv3.common.synchronization [None req-038e9ea0-5758-4ada-a0ae-86ea89143637 None None] Enqueued Resource ID: 3f06d352-74aa-4cb2-84db-679b6054ac55 with Priority: HIGHEST for action port [ 1330.354281] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f06d352-74aa-4cb2-84db-679b6054ac55 with Priority: HIGHEST for action port [ 1330.354594] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f06d352-74aa-4cb2-84db-679b6054ac55 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.354720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f06d352-74aa-4cb2-84db-679b6054ac55" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.354788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f06d352-74aa-4cb2-84db-679b6054ac55" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.355054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f06d352-74aa-4cb2-84db-679b6054ac55" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.355152] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f06d352-74aa-4cb2-84db-679b6054ac55',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.857821] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f06d352-74aa-4cb2-84db-679b6054ac55 [ 1330.858116] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.858252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.858316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.858562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.858708] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.858809] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f06d352-74aa-4cb2-84db-679b6054ac55 already deleted. [ 1330.858933] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f06d352-74aa-4cb2-84db-679b6054ac55" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.594678] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: SUCCESS [ 1331.594960] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.621742] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1331.621939] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.155935] env[66157]: INFO networking_nsxv3.common.synchronization [req-ebc7190f-e8ae-4438-89c5-0f18f4889d5b req-e926f9ca-8950-42c5-8c2f-d624d487f8dd tempest-AttachVolumeShelveTestJSON-1165064594 tempest-AttachVolumeShelveTestJSON-1165064594-project-member] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_members [ 1334.156574] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_members [ 1334.156889] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.156996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.157079] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.157336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.157489] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.157586] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.157646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.157795] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.157880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.157979] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.413669] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.413877] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.414008] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.414353] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.414627] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.414797] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.414902] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.415167] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.415326] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.415540] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1334.415658] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1334.415768] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1334.415877] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1334.415986] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1334.416371] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1334.416371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1334.436312] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1334.436562] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1334.436728] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1334.436915] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.437242] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.437420] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.437606] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.437846] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.437991] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fdabe4-5bb9-4229-905a-d64c088e8b9b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.660054] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.660272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.660272] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.660484] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.660575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.660767] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.660863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.660924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.661081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.661156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.661240] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 already deleted. [ 1334.661319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.940382] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.940602] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.940725] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.941018] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.941169] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.941345] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Segment Port d6fdabe4-5bb9-4229-905a-d64c088e8b9b not found, creating... [ 1334.941761] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.941883] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.941928] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.942162] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.942253] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.942550] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.942703] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.942818] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.943042] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.943213] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.943348] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: d6fdabe4-5bb9-4229-905a-d64c088e8b9b is going to be created. [ 1334.962483] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.962745] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.962880] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.963231] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.963464] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.963755] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.664665] env[66157]: INFO networking_nsxv3.common.synchronization [req-ebc7190f-e8ae-4438-89c5-0f18f4889d5b req-955e0444-4632-4f76-b98a-822c97f2a026 service nova] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_rules [ 1335.664909] env[66157]: INFO networking_nsxv3.common.synchronization [req-ebc7190f-e8ae-4438-89c5-0f18f4889d5b req-955e0444-4632-4f76-b98a-822c97f2a026 service nova] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_members [ 1335.664981] env[66157]: INFO networking_nsxv3.common.synchronization [req-ebc7190f-e8ae-4438-89c5-0f18f4889d5b req-955e0444-4632-4f76-b98a-822c97f2a026 service nova] Enqueued Resource ID: d6fdabe4-5bb9-4229-905a-d64c088e8b9b with Priority: HIGHEST for action port [ 1335.665572] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_rules [ 1335.665707] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_members [ 1335.665812] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6fdabe4-5bb9-4229-905a-d64c088e8b9b with Priority: HIGHEST for action port [ 1335.666780] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.666912] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.667315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.667315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.667315] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.668502] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.668614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.668699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.669020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.669177] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.669275] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.669337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.669477] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.669562] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.669652] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.671244] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.671244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.671244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.671244] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.671453] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fdabe4-5bb9-4229-905a-d64c088e8b9b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.172330] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.173486] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.173614] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.173766] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6fdabe4-5bb9-4229-905a-d64c088e8b9b with status ACTIVE [ 1336.173920] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.174041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.174097] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.174321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.174390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.174564] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.174676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.174721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.174859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.174931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.175757] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.175932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.175932] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.176690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.176690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.176690] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6fdabe4-5bb9-4229-905a-d64c088e8b9b is going to be updated. [ 1336.199929] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.199929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.199929] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.200240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.200379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.200619] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.678806] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.182538] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.182744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.182900] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.182979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.183521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.183521] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 is going to be created. [ 1337.207765] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.207941] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.208020] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.208231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.208398] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.218165] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: UNINITIALIZED for 2s [ 1339.229206] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: UNINITIALIZED for 4s [ 1340.666561] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.666941] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1341.242746] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: SUCCESS [ 1341.243599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.243599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.243599] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.243718] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.243780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.243818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.243945] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.244041] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.244132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.244254] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.747024] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.249660] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e94024-6bb7-4680-953e-a6a381af9f71: rpc.has_security_group_logging(os_id): False [ 1342.269417] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.269616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.269616] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.269964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.270080] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.270355] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.270454] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.270512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.270925] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.270988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.271107] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 is going to be created. [ 1342.339635] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.339859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.339859] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.340098] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.340327] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.353263] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: IN_PROGRESS for 2s [ 1344.367839] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: SUCCESS [ 1344.368215] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.667997] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.668391] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.663886] env[66157]: INFO networking_nsxv3.common.synchronization [req-2679703d-f660-4726-ab90-14f601873b2e req-041398ba-9e8b-492c-9d14-0abf6c5b0f8d tempest-AttachVolumeTestJSON-1599628970 tempest-AttachVolumeTestJSON-1599628970-project-member] Enqueued Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_members [ 1348.664444] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGHEST for action security_group_members [ 1348.664750] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.664866] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.664926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.665924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.665924] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.665924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.665924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.665924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.665924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.665924] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.168200] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.168408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.168408] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.168621] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.168713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.168910] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.169017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.169085] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.169232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.169307] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.169392] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a11d247-5b58-4309-be42-e273703c703a is going to be updated. [ 1349.201029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.201263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.201263] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.201500] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.201669] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.210598] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: IN_PROGRESS for 2s [ 1351.233295] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: IN_PROGRESS for 4s [ 1353.244908] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a11d247-5b58-4309-be42-e273703c703a in Status: SUCCESS [ 1353.245254] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a11d247-5b58-4309-be42-e273703c703a deletion is rescheduled due to dependency. [ 1353.245254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.666018] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.666237] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.667273] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.667587] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.668396] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.668798] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.133214] env[66157]: INFO networking_nsxv3.common.synchronization [req-3c8a2578-e8ee-4d77-a483-40db140257d6 req-ea456ab7-1866-430c-9d84-8cc8eb833579 tempest-ServerActionsTestOtherB-552517833 tempest-ServerActionsTestOtherB-552517833-project-member] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1365.133214] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1365.133214] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.133214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.133214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.133214] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.134064] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.134329] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.134496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.134766] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.134956] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.135151] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.637602] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.637864] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.638033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.638378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.638564] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.639124] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.639293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.639460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.639918] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.640040] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.640273] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1365.682250] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.682415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.682492] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.682676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.682818] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.691298] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1367.702866] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1367.703269] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a deletion is rescheduled due to dependency. [ 1367.703269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.133684] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.134080] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.917768] env[66157]: INFO networking_nsxv3.common.synchronization [req-85a460e2-6f33-4c3f-88bf-cc36492b687e req-46f985a9-c967-4a6e-80a4-e9d18ada9e04 tempest-ServersTestBootFromVolume-544437522 tempest-ServersTestBootFromVolume-544437522-project-member] Enqueued Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_members [ 1372.917975] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGHEST for action security_group_members [ 1372.918532] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-506c0ef8-aa46-420a-8a0a-fede11258a2b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.918690] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.918903] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.919124] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.919521] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.919521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.919521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.919849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.919849] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.919849] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.422545] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.422808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.422808] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.422992] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.423115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.423309] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.423409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.423465] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.423617] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.423707] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.423833] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b is going to be updated. [ 1373.451856] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.452100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.452100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.452296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.452516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.464598] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b in Status: IN_PROGRESS for 2s [ 1374.431394] env[66157]: INFO networking_nsxv3.common.synchronization [req-e90a7f78-b2ef-4914-9487-230c09a5cd20 req-863e40d7-75a9-4140-98ed-17dd4d80dcff tempest-ServerActionsTestOtherB-552517833 tempest-ServerActionsTestOtherB-552517833-project-member] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1374.431968] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1374.432299] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.432417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.432519] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.432667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.432814] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.432910] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.432968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.433315] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.433424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.433576] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.765139] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.765340] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.765463] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.765733] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.766041] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.766215] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.766318] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.766523] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.766668] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.766880] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1374.766995] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1374.767123] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1374.767277] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1374.767352] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1374.767456] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1374.767583] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1374.786683] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1374.786877] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1374.787031] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1374.787258] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.787577] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.787747] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.787867] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.788276] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.788418] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee319c02-964a-4f9b-8ed5-6e1445b7e4a3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.935620] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.935858] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.935979] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.936240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.936339] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.936565] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.936676] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.936741] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.937055] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.937188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.937257] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1374.962739] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.962739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.962739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.962739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.962739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.970573] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1375.291273] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.291525] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.291636] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.291943] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.292111] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.292267] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 not found, creating... [ 1375.292572] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.292733] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.292849] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.293078] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.293280] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.293593] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.293770] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.293887] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.294121] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.294256] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.294392] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 is going to be created. [ 1375.315120] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.315334] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.315456] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.315727] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.316049] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.316274] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.477547] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b in Status: SUCCESS [ 1375.478139] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b deletion is rescheduled due to dependency. [ 1375.478139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.006272] env[66157]: INFO networking_nsxv3.common.synchronization [req-e90a7f78-b2ef-4914-9487-230c09a5cd20 req-7e5c8e3d-c609-4b33-bb70-4db70f109f14 service nova] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1376.006529] env[66157]: INFO networking_nsxv3.common.synchronization [req-e90a7f78-b2ef-4914-9487-230c09a5cd20 req-7e5c8e3d-c609-4b33-bb70-4db70f109f14 service nova] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1376.006529] env[66157]: INFO networking_nsxv3.common.synchronization [req-e90a7f78-b2ef-4914-9487-230c09a5cd20 req-7e5c8e3d-c609-4b33-bb70-4db70f109f14 service nova] Enqueued Resource ID: ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 with Priority: HIGHEST for action port [ 1376.007088] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1376.007226] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1376.007321] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 with Priority: HIGHEST for action port [ 1376.007585] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.007752] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.007791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.007949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.008095] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.008834] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.008926] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.009128] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.009224] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.009287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.009833] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.009833] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee319c02-964a-4f9b-8ed5-6e1445b7e4a3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.511545] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.511947] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.511947] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 with status ACTIVE [ 1376.512066] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.512141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.512209] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.512424] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.512512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.512685] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.512778] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.512838] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.512986] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.513074] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.513251] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.513340] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.513400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.513534] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.513605] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.513687] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 is going to be updated. [ 1376.533847] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.534066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.534066] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.534184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.534312] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.534466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.980131] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1376.980335] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a deletion is rescheduled due to dependency. [ 1376.980427] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.980779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.980779] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.980953] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.981081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.981145] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.981310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.981410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.981519] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.483548] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.986244] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.490631] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.490631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.490631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.490631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.490631] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.490631] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1378.525206] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.525350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.525350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.525521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.525718] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.534606] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1380.545397] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1380.545777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.545777] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.546026] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.546230] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.546347] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.546413] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.546575] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.546655] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.546739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.546827] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.008797] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.008981] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1381.048622] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.551349] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 612116dc-6e5d-4737-93ca-c21312262c3a: rpc.has_security_group_logging(os_id): False [ 1381.570098] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.570352] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.570407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.570597] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.570684] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.570944] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.571053] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.571175] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.571335] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.571410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.571486] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1381.629393] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.629626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.629626] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.629790] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.629936] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.644716] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1383.660974] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1383.661296] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.009953] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.010361] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.010895] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.011367] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.011835] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.012262] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.013507] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.013850] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.014443] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.014878] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.016046] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.016429] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.512706] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.513054] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.513054] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.513365] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.513582] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.513738] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.513854] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.514082] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.514229] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.514436] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1413.514713] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1413.514713] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1413.514858] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1413.514973] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1413.515100] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1413.515249] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1413.535873] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1413.536073] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1413.536188] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1413.536472] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.536841] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.537076] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.537207] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.537460] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.537618] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fdabe4-5bb9-4229-905a-d64c088e8b9b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.040266] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.040534] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.040720] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.041232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.041232] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.041512] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.041682] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.041792] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.042035] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.042180] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.042512] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.042730] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.042869] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.043105] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.043268] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.043423] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: d6fdabe4-5bb9-4229-905a-d64c088e8b9b is going to be updated. [ 1414.070394] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.070709] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.070709] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.070987] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.071199] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.071440] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.763364] env[66157]: INFO networking_nsxv3.common.synchronization [req-dc7121f6-703c-46c3-9d72-b36903aa22ac req-36e874ae-5fa8-4c3f-833f-a9fe0619e1cd service nova] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_rules [ 1414.763671] env[66157]: INFO networking_nsxv3.common.synchronization [req-dc7121f6-703c-46c3-9d72-b36903aa22ac req-36e874ae-5fa8-4c3f-833f-a9fe0619e1cd service nova] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_members [ 1414.763728] env[66157]: INFO networking_nsxv3.common.synchronization [req-dc7121f6-703c-46c3-9d72-b36903aa22ac req-36e874ae-5fa8-4c3f-833f-a9fe0619e1cd service nova] Enqueued Resource ID: d6fdabe4-5bb9-4229-905a-d64c088e8b9b with Priority: HIGHEST for action port [ 1414.764441] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_rules [ 1414.764514] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_members [ 1414.764736] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6fdabe4-5bb9-4229-905a-d64c088e8b9b with Priority: HIGHEST for action port [ 1414.764899] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.765036] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.765106] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.765304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.765387] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.766293] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.766400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.766400] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.766601] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.767231] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.767231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.767231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.767231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.767231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.767231] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.767983] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.768113] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.768378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.768378] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.768378] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6fdabe4-5bb9-4229-905a-d64c088e8b9b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.270187] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.270435] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.270551] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.271607] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6fdabe4-5bb9-4229-905a-d64c088e8b9b with status ACTIVE [ 1415.271826] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.271931] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.271993] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.272265] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.272466] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.272679] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.272816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.272893] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.273592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.273592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.273592] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.273592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.273592] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.273883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.273883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.273957] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6fdabe4-5bb9-4229-905a-d64c088e8b9b is going to be updated. [ 1415.297119] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.297374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.297374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.297640] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.297823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.297984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6fdabe4-5bb9-4229-905a-d64c088e8b9b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.776075] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.279271] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.279560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.279560] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.279682] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.279792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.280012] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 is going to be updated. [ 1416.342553] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.342812] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.342922] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.343258] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.343551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.356036] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: IN_PROGRESS for 2s [ 1418.368967] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: SUCCESS [ 1418.369409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.369409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.369651] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.369861] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.369988] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.370088] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.370294] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.370418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.370547] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.370693] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.873688] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.376523] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e94024-6bb7-4680-953e-a6a381af9f71: rpc.has_security_group_logging(os_id): False [ 1419.396797] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.397090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.397090] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.397232] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.397322] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.397571] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.397689] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.397771] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.397924] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.398000] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.398110] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 is going to be updated. [ 1419.467740] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.468035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.468035] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.468184] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.468330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.485264] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: IN_PROGRESS for 2s [ 1419.766024] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.766362] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1421.498760] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: SUCCESS [ 1421.499305] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.767049] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.767465] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.768697] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.768697] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.769635] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.770059] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.771106] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.771532] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.772790] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.773457] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.774729] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.775284] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.536906] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.537305] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.537305] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.537633] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.538136] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.538444] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.538657] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.539016] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.539238] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.539463] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1451.539629] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1451.539813] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1451.539995] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1451.540168] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1451.540283] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1451.540445] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1451.564018] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1451.564217] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1451.564348] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1451.564517] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-250" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.564836] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.565016] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.565141] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.565442] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.565578] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee319c02-964a-4f9b-8ed5-6e1445b7e4a3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.068312] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.068637] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.068715] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.068972] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.069144] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.069441] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.069597] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.069712] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.069933] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.070087] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.070366] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.070516] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.070631] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.070835] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.070967] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.071118] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 is going to be updated. [ 1452.094391] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.094657] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.094712] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.094972] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.095190] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.095435] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.769240] env[66157]: INFO networking_nsxv3.common.synchronization [req-8a992680-041d-47c7-abf5-ef7d22d1b644 req-7fc3a322-6a72-468a-862f-a5a8c2d729ff service nova] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1452.769556] env[66157]: INFO networking_nsxv3.common.synchronization [req-8a992680-041d-47c7-abf5-ef7d22d1b644 req-7fc3a322-6a72-468a-862f-a5a8c2d729ff service nova] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1452.769556] env[66157]: INFO networking_nsxv3.common.synchronization [req-8a992680-041d-47c7-abf5-ef7d22d1b644 req-7fc3a322-6a72-468a-862f-a5a8c2d729ff service nova] Enqueued Resource ID: ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 with Priority: HIGHEST for action port [ 1452.770170] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_rules [ 1452.770314] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1452.770415] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 with Priority: HIGHEST for action port [ 1452.770687] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.770810] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.770880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.771360] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.771360] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.772321] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.772415] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.772511] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.772654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.772802] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.772896] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.772961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.773148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.773250] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.773344] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.774116] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.774549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.774549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.774549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.774549] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee319c02-964a-4f9b-8ed5-6e1445b7e4a3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.276768] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.277065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.277207] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.278134] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 with status ACTIVE [ 1453.278314] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.278436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.278513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.278727] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.278832] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.278983] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.279093] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.279150] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.279304] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.279379] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.279554] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.279672] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.279806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.279871] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.280695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.280695] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee319c02-964a-4f9b-8ed5-6e1445b7e4a3 is going to be updated. [ 1453.304605] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.304816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.304816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.305017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.305154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.305316] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee319c02-964a-4f9b-8ed5-6e1445b7e4a3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.781953] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.284461] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.284667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.284802] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.285032] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.285128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.285229] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1454.335234] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.335497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.335497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.335653] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.335888] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.359691] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1456.372594] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1456.372594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.373125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.373125] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.373213] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.373297] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.373351] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.373494] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.373577] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.373652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.373750] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.876620] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.379596] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 612116dc-6e5d-4737-93ca-c21312262c3a: rpc.has_security_group_logging(os_id): False [ 1457.402874] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.403131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.403131] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.403350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.403453] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.403774] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.403881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.403963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.404123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.404200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.404293] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1457.466906] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.466906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.466906] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.467076] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.467149] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.480380] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1457.772108] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.772228] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1459.497244] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1459.497700] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.773932] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.774355] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.774838] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.775293] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.470674] env[66157]: INFO networking_nsxv3.common.synchronization [req-e1245c0a-836f-45de-af5c-9456a422f1a1 req-61778aea-2b90-4803-b016-de16e7087a83 tempest-ServerActionsTestOtherB-552517833 tempest-ServerActionsTestOtherB-552517833-project-member] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1468.471392] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGHEST for action security_group_members [ 1468.471392] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.471596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.471596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.471748] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.471890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.471987] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.472067] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.472216] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.472303] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.472401] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.978083] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.978083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.978083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.978083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.978083] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.978654] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.978654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.978654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.978792] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.978828] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.978968] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be updated. [ 1469.005672] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.005908] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.005958] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.006262] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.006490] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.016231] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: IN_PROGRESS for 2s [ 1471.027456] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 612116dc-6e5d-4737-93ca-c21312262c3a in Status: SUCCESS [ 1471.027892] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a deletion is rescheduled due to dependency. [ 1471.027892] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.472656] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.473044] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.958642] env[66157]: INFO networking_nsxv3.common.synchronization [req-046666a8-bddb-41c4-b7ca-3886e4753ec3 req-196e985b-6a5f-4dda-8988-ca99a5f7778b tempest-AttachVolumeShelveTestJSON-1165064594 tempest-AttachVolumeShelveTestJSON-1165064594-project-member] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_members [ 1473.958938] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGHEST for action security_group_members [ 1473.959415] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.959685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.959685] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.959800] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.960295] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.960295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.960295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.960295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.960495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.960495] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.463109] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.463109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.463109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.463109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.463109] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.463480] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.463480] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.463572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.463665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.463742] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.463841] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 is going to be updated. [ 1474.491139] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.491549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.491549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.491549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.491670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.500658] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: IN_PROGRESS for 2s [ 1476.513536] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e94024-6bb7-4680-953e-a6a381af9f71 in Status: SUCCESS [ 1476.513934] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 deletion is rescheduled due to dependency. [ 1476.513934] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.699691] env[66157]: INFO networking_nsxv3.common.synchronization [None req-bf376f86-1c22-4e8c-911e-3b7cac502a77 tempest-AttachVolumeShelveTestJSON-1165064594 tempest-AttachVolumeShelveTestJSON-1165064594-project-member] Enqueued Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_rules [ 1478.700229] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_rules [ 1478.700541] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.700648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.700721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.700968] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.701189] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.779284] env[66157]: INFO networking_nsxv3.common.synchronization [None req-9944ebe0-7a7f-481c-867c-42b58dcb806e tempest-AttachVolumeShelveTestJSON-1165064594 tempest-AttachVolumeShelveTestJSON-1165064594-project-member] Enqueued Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_rules [ 1478.780062] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_rules [ 1478.780390] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.780545] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.222792] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.222984] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.223046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.223229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.223321] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.223416] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 already deleted. [ 1479.223499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.223646] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.223801] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.223887] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1479.743077] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.743478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.743478] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.743556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.743593] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.743680] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 already deleted. [ 1479.743763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.781399] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.781723] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.108818] env[66157]: INFO networking_nsxv3.common.synchronization [req-7671bb40-a93c-49e0-85be-7233c610c3af req-f7c7d5b2-040b-4363-9b34-ac8323888e22 tempest-AttachVolumeShelveTestJSON-1165064594 tempest-AttachVolumeShelveTestJSON-1165064594-project-member] Enqueued Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_members [ 1484.109391] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_members [ 1484.109719] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.109852] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.109917] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.110354] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.110550] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.110636] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.110699] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.110843] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.110949] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.111054] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.366384] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.366598] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.366725] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.366989] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.367260] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.367417] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.367532] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.367743] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.367888] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.368125] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1484.368272] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1484.368384] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1484.368480] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1484.368586] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1484.368699] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1484.368829] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1484.390304] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1484.390477] env[66157]: DEBUG dogpile.cache.region [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1484.390679] env[66157]: DEBUG dogpile.lock [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1484.390882] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.391241] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock port-9a269e8f-1e58-43ef-a274-d1f51f755264 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.391454] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.391625] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.391987] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.392146] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a269e8f-1e58-43ef-a274-d1f51f755264',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.612983] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.613223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.613223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.613407] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.613501] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.613692] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.613788] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.613851] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.613991] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.614078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.614168] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 already deleted. [ 1484.614269] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.894585] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.894585] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.895188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.895188] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.895317] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.895526] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Segment Port 9a269e8f-1e58-43ef-a274-d1f51f755264 not found, creating... [ 1484.895887] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.896157] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.896287] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.896563] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.896733] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.897068] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.897230] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.897350] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.897588] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.897747] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.897890] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Resource: SegmentPort with ID: 9a269e8f-1e58-43ef-a274-d1f51f755264 is going to be created. [ 1484.922519] env[66157]: DEBUG networking_nsxv3.common.locking [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.922790] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.922926] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.923253] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.923520] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.923770] env[66157]: DEBUG oslo_concurrency.lockutils [None req-6406403b-1c10-46ab-b0b9-125059f57bc4 None None] Releasing lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.602829] env[66157]: INFO networking_nsxv3.common.synchronization [req-7671bb40-a93c-49e0-85be-7233c610c3af req-a306df46-acf2-4b57-82d0-dce7ce37afa1 service nova] Enqueued Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_rules [ 1485.603097] env[66157]: INFO networking_nsxv3.common.synchronization [req-7671bb40-a93c-49e0-85be-7233c610c3af req-a306df46-acf2-4b57-82d0-dce7ce37afa1 service nova] Enqueued Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_members [ 1485.603187] env[66157]: INFO networking_nsxv3.common.synchronization [req-7671bb40-a93c-49e0-85be-7233c610c3af req-a306df46-acf2-4b57-82d0-dce7ce37afa1 service nova] Enqueued Resource ID: 9a269e8f-1e58-43ef-a274-d1f51f755264 with Priority: HIGHEST for action port [ 1485.603442] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_rules [ 1485.603532] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_members [ 1485.603604] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a269e8f-1e58-43ef-a274-d1f51f755264 with Priority: HIGHEST for action port [ 1485.604256] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.604377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.604456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.604670] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.604753] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.605994] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.606230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.606310] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.606476] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.607042] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.607042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.607042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.607042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.607042] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.607334] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.608196] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a269e8f-1e58-43ef-a274-d1f51f755264 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.608324] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.608504] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.608971] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.609067] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a269e8f-1e58-43ef-a274-d1f51f755264',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.106737] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.107139] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.109214] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.110752] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a269e8f-1e58-43ef-a274-d1f51f755264 with status ACTIVE [ 1486.111065] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.111260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.111260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.111456] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.111548] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.111723] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.111819] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.111881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.112046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.112148] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.112293] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.112388] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.112449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.112582] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.112654] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.112738] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a269e8f-1e58-43ef-a274-d1f51f755264 is going to be updated. [ 1486.133044] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.133238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.133238] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.133430] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.133569] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.133720] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.611832] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.114156] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.114512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.114512] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.114600] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.114688] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.114816] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 is going to be created. [ 1487.144168] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.144372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.144423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.144633] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.144880] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.154686] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: UNINITIALIZED for 2s [ 1489.165836] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: SUCCESS [ 1489.166252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.166252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.166422] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.166621] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.166739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.166804] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.166959] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.167054] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.167138] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.167227] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.669852] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.172762] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 738bf55f-e3d8-4256-b3de-164336c95608: rpc.has_security_group_logging(os_id): False [ 1490.192864] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.193127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.193127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.193372] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.193469] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.193861] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.193994] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.194078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.194318] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.194396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.194487] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 is going to be created. [ 1490.265884] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.266177] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.266247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.266568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.266793] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.279289] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: IN_PROGRESS for 2s [ 1490.604254] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.604434] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1492.292575] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: SUCCESS [ 1492.292969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.605682] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.606121] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.607173] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.607617] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.608516] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.608950] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.609782] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.610228] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.611021] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.611408] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.612414] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.612774] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.555950] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1525.556413] env[66157]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-cf84ad9e-7926-41e7-82e3-cbbd3248228f None None] NSXv3 Agent Agent loop - iteration:4 started [ 1525.613077] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.613263] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.613690] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.614123] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.614715] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.615126] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1540.615921] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.615921] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.616839] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.617110] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.617764] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.618242] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.619162] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.619616] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1558.420505] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.420919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.420919] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.421081] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.421387] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.421579] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.421664] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.421881] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.422036] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.422250] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1558.422360] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] NeedRegenerationException {{(pid=66157) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1558.422468] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] no value, waiting for create lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1558.422601] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] value creation lock acquired {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1558.422712] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] No value present for key: 'zone-id' {{(pid=66157) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1558.422815] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Calling creation function for not-yet-present value {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1558.422942] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1558.453611] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1558.453864] env[66157]: DEBUG dogpile.cache.region [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66157) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1558.453950] env[66157]: DEBUG dogpile.lock [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Released creation lock {{(pid=66157) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1558.454107] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "network-990" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.454464] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock port-9a269e8f-1e58-43ef-a274-d1f51f755264 taken with stack trace [, , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.454676] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.454802] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.455019] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.455148] env[66157]: DEBUG networking_nsxv3.api.rpc [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a269e8f-1e58-43ef-a274-d1f51f755264',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1558.957839] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.958082] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.958260] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.958541] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.958690] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.958976] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.959147] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.959261] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.959469] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.959604] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.959881] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.960043] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.960200] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.960409] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.960545] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.960683] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Resource: SegmentPort with ID: 9a269e8f-1e58-43ef-a274-d1f51f755264 is going to be updated. [ 1558.983534] env[66157]: DEBUG networking_nsxv3.common.locking [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.983790] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.983904] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.984233] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.984473] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.984690] env[66157]: DEBUG oslo_concurrency.lockutils [None req-da475c1b-d05b-4530-bd2d-920345da0038 None None] Releasing lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.644893] env[66157]: INFO networking_nsxv3.common.synchronization [req-59135f73-653b-4eaf-897c-82bfa2c53b87 req-e31183b0-6f6b-4a86-9cba-70292322360d service nova] Enqueued Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_rules [ 1559.645157] env[66157]: INFO networking_nsxv3.common.synchronization [req-59135f73-653b-4eaf-897c-82bfa2c53b87 req-e31183b0-6f6b-4a86-9cba-70292322360d service nova] Enqueued Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_members [ 1559.645198] env[66157]: INFO networking_nsxv3.common.synchronization [req-59135f73-653b-4eaf-897c-82bfa2c53b87 req-e31183b0-6f6b-4a86-9cba-70292322360d service nova] Enqueued Resource ID: 9a269e8f-1e58-43ef-a274-d1f51f755264 with Priority: HIGHEST for action port [ 1559.645765] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_rules [ 1559.645907] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_members [ 1559.646016] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a269e8f-1e58-43ef-a274-d1f51f755264 with Priority: HIGHEST for action port [ 1559.646629] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.646756] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.646827] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.647033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.647117] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.648362] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.648473] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.648645] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.648820] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.648966] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.649533] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.649610] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.649780] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.650046] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.650046] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.653168] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a269e8f-1e58-43ef-a274-d1f51f755264 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.653168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.653168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.653168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.653168] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a269e8f-1e58-43ef-a274-d1f51f755264',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.149529] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.149773] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.152060] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.153500] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a269e8f-1e58-43ef-a274-d1f51f755264 with status ACTIVE [ 1560.153698] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.153816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.153881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.155071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.155071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.155071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.155071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.155071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.155071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.155071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.155071] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.155071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.155071] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.155625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.155625] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.155625] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a269e8f-1e58-43ef-a274-d1f51f755264 is going to be updated. [ 1560.174866] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.175084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.175084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.175260] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.175397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.175554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a269e8f-1e58-43ef-a274-d1f51f755264" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.654282] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.156382] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.156559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.156680] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.156966] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.157132] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.157264] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 is going to be updated. [ 1561.190427] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.190648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.190648] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.190835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.190974] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.200702] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: IN_PROGRESS for 2s [ 1562.493942] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.494346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.494346] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.494445] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.494509] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.996636] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.211145] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: SUCCESS [ 1563.211377] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.211549] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.211761] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.211950] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.212078] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.212141] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.212287] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.212364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.212448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.212538] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.499321] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.714713] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.002111] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1564.002421] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1564.217631] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 738bf55f-e3d8-4256-b3de-164336c95608: rpc.has_security_group_logging(os_id): False [ 1564.241758] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.242058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.242058] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.242229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.242306] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.242562] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.242665] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.242710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.242902] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.242963] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.243032] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 is going to be updated. [ 1564.303868] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.304123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.304123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.304381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.304556] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.317080] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: IN_PROGRESS for 2s [ 1564.647181] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.647593] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1564.787147] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.787384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.787384] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.787572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.799666] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1564.802875] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.803868] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1564.841582] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.841845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.841845] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.842017] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.855178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.856132] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1564.856260] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1564.856307] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1564.888830] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.889084] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.889154] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.889365] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.890063] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.890281] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1564.967276] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.967508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.967508] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.967692] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.968022] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.968287] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1565.040714] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.040957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.040957] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.041249] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.041572] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.041895] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:24. [ 1565.042021] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'506c0ef8-aa46-420a-8a0a-fede11258a2b', '9a11d247-5b58-4309-be42-e273703c703a', '58626db2-1bef-478d-8fe6-5cb88f964fa3', 'c4915dbf-d6e2-46dd-8508-11f50b8da0ef', '099cf4d4-ded3-44df-b6e7-328bc3763be6', '7a251e98-2d26-4017-96a0-c67e8ea7efc0', 'd99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d', '6b93b3d3-7a24-441f-88d0-38d5293ec145', '047471a8-6f49-4481-a53f-c45f9c23e798', '4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1', '8a39b75b-de15-457f-a080-b14841d7ea90', '7b48ccef-7f9a-4d48-8b46-294031485bbd', 'd46b1e4e-446b-4001-9e14-1ab5b40a8087', '21980f25-eb0b-4647-8b51-f835b6f941ea', '8cb67253-fbd5-4c41-8d67-3b3c6d1bc719', '1ed4675f-1916-4e79-b525-fb7797e97825', '06e94024-6bb7-4680-953e-a6a381af9f71', '612116dc-6e5d-4737-93ca-c21312262c3a', '4bb5a370-76e0-4d7c-9a46-84239200c704', 'd5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24', '738bf55f-e3d8-4256-b3de-164336c95608', '1dae1e84-05f3-49da-b3a4-8d3f4e788988', 'fec754f5-f737-48ef-9255-9d4bc7df0c2e', 'a38d5e1a-6785-4c65-98b8-9c43e55d070c'} {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1565.042132] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1565.063081] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.063331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.063331] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.063497] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.063585] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.063698] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1565.063771] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1565.063845] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1565.134857] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.135142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.135142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.135293] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.136458] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.136717] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1565.136803] env[66157]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66157) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1565.136865] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1565.136932] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1565.137020] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/24 resources of Type:Security Group Rules [ 1565.137099] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGH for action security_group_rules [ 1565.137204] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGH for action security_group_rules [ 1565.137286] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGH for action security_group_rules [ 1565.137351] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGH for action security_group_rules [ 1565.137417] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGH for action security_group_rules [ 1565.137480] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGH for action security_group_rules [ 1565.137545] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGH for action security_group_rules [ 1565.137604] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGH for action security_group_rules [ 1565.137665] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGH for action security_group_rules [ 1565.137736] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGH for action security_group_rules [ 1565.137836] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGH for action security_group_rules [ 1565.137932] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGH for action security_group_rules [ 1565.138046] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGH for action security_group_rules [ 1565.138148] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGH for action security_group_rules [ 1565.138256] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGH for action security_group_rules [ 1565.138400] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGH for action security_group_rules [ 1565.138539] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGH for action security_group_rules [ 1565.138596] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGH for action security_group_rules [ 1565.138677] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGH for action security_group_rules [ 1565.138788] env[66157]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGH for action security_group_rules [ 1565.138938] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.331270] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: SUCCESS [ 1566.331687] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.648795] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.649187] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1569.649187] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b with Priority: HIGH for action security_group_rules [ 1569.649293] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 with Priority: HIGH for action security_group_rules [ 1569.649293] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d with Priority: HIGH for action security_group_rules [ 1569.649399] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 with Priority: HIGH for action security_group_rules [ 1569.649501] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 with Priority: HIGH for action security_group_rules [ 1569.649597] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 with Priority: HIGH for action security_group_rules [ 1569.649701] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 612116dc-6e5d-4737-93ca-c21312262c3a with Priority: HIGH for action security_group_rules [ 1569.649813] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e94024-6bb7-4680-953e-a6a381af9f71 with Priority: HIGH for action security_group_rules [ 1569.649917] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21980f25-eb0b-4647-8b51-f835b6f941ea with Priority: HIGH for action security_group_rules [ 1569.649993] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed4675f-1916-4e79-b525-fb7797e97825 with Priority: HIGH for action security_group_rules [ 1569.650098] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 with Priority: HIGH for action security_group_rules [ 1569.650189] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd with Priority: HIGH for action security_group_rules [ 1569.650278] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a39b75b-de15-457f-a080-b14841d7ea90 with Priority: HIGH for action security_group_rules [ 1569.650364] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 with Priority: HIGH for action security_group_rules [ 1569.650452] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047471a8-6f49-4481-a53f-c45f9c23e798 with Priority: HIGH for action security_group_rules [ 1569.650612] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 with Priority: HIGH for action security_group_rules [ 1569.650711] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 with Priority: HIGH for action security_group_rules [ 1569.650800] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 with Priority: HIGH for action security_group_rules [ 1569.650895] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a11d247-5b58-4309-be42-e273703c703a with Priority: HIGH for action security_group_rules [ 1569.650989] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef with Priority: HIGH for action security_group_rules [ 1569.651362] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506c0ef8-aa46-420a-8a0a-fede11258a2b taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.651516] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.651591] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.651829] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.651913] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506c0ef8-aa46-420a-8a0a-fede11258a2b',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.653053] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58626db2-1bef-478d-8fe6-5cb88f964fa3 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.653172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.653172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.653364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.653442] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58626db2-1bef-478d-8fe6-5cb88f964fa3',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.654293] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.654409] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.654472] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.654667] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.654744] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.656243] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.656364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.656417] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.656823] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.656823] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cb67253-fbd5-4c41-8d67-3b3c6d1bc719',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.657401] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.657656] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.657726] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.657884] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.657994] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.659226] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bb5a370-76e0-4d7c-9a46-84239200c704 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.659344] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.659386] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.659538] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.659609] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bb5a370-76e0-4d7c-9a46-84239200c704',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.660761] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-612116dc-6e5d-4737-93ca-c21312262c3a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.660894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.660894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.661065] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.661145] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('612116dc-6e5d-4737-93ca-c21312262c3a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.662444] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e94024-6bb7-4680-953e-a6a381af9f71 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.662543] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.662603] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.662709] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.662789] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e94024-6bb7-4680-953e-a6a381af9f71',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.664029] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21980f25-eb0b-4647-8b51-f835b6f941ea taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.664188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.664188] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.664328] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.664373] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21980f25-eb0b-4647-8b51-f835b6f941ea',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.666014] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ed4675f-1916-4e79-b525-fb7797e97825 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.666014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.666014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.673816] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ed4675f-1916-4e79-b525-fb7797e97825',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.673816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.673816] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46b1e4e-446b-4001-9e14-1ab5b40a8087',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.673816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b48ccef-7f9a-4d48-8b46-294031485bbd taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.673816] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b48ccef-7f9a-4d48-8b46-294031485bbd',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.673816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a39b75b-de15-457f-a080-b14841d7ea90 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.673816] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.673816] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a39b75b-de15-457f-a080-b14841d7ea90',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.673816] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.675366] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.675366] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-047471a8-6f49-4481-a53f-c45f9c23e798 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.675366] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('047471a8-6f49-4481-a53f-c45f9c23e798',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.675366] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.675366] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.675366] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a251e98-2d26-4017-96a0-c67e8ea7efc0',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.676254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b93b3d3-7a24-441f-88d0-38d5293ec145 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.676254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.676254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.676254] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.676254] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b93b3d3-7a24-441f-88d0-38d5293ec145',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.677561] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-099cf4d4-ded3-44df-b6e7-328bc3763be6 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.677719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.677719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.677951] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.678025] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('099cf4d4-ded3-44df-b6e7-328bc3763be6',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.679175] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a11d247-5b58-4309-be42-e273703c703a taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.679330] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.679406] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.679506] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.679577] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a11d247-5b58-4309-be42-e273703c703a',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.680605] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.680739] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.680803] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.680961] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.681053] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4915dbf-d6e2-46dd-8508-11f50b8da0ef',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.707436] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.707568] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.707644] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.707861] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.730073] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.730073] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506c0ef8-aa46-420a-8a0a-fede11258a2b is going to be deleted. [ 1569.788085] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.788336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.788336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.788523] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.788594] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.788724] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506c0ef8-aa46-420a-8a0a-fede11258a2b" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.203518] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.203668] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.203747] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.203921] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.206101] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.206251] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.208676] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.208781] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.210439] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.210559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.211254] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.211350] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.213277] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.213381] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.220737] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.220920] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.247217] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.247434] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.248222] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.248319] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.249013] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.249156] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.249770] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.249881] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.250480] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1570.250899] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.251033] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.251645] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1570.252123] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.252123] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.252719] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1570.253111] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.253200] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.253876] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1570.254248] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.254343] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.254918] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1570.255301] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.255410] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.255983] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1570.256349] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.256438] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.257115] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1570.257475] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.257566] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.258157] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1570.258550] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.258682] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bb5a370-76e0-4d7c-9a46-84239200c704 is going to be deleted. [ 1570.260103] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.260199] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.260270] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.260449] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.278252] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.278411] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cb67253-fbd5-4c41-8d67-3b3c6d1bc719 is going to be deleted. [ 1570.279229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.279431] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.296240] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.296449] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24 is going to be deleted. [ 1570.297271] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.297496] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.315362] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.315597] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a251e98-2d26-4017-96a0-c67e8ea7efc0 is going to be deleted. [ 1570.316392] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.316608] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.330605] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.330791] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.333079] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.333223] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.334894] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.335024] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 612116dc-6e5d-4737-93ca-c21312262c3a is going to be deleted. [ 1570.335830] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.336051] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.372467] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.372689] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e94024-6bb7-4680-953e-a6a381af9f71 is going to be deleted. [ 1570.373481] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.373695] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.384894] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.385087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.413396] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.413591] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b93b3d3-7a24-441f-88d0-38d5293ec145 is going to be deleted. [ 1570.414495] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.414730] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.416169] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.416278] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.418198] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.418300] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.442385] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.442597] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 099cf4d4-ded3-44df-b6e7-328bc3763be6 is going to be deleted. [ 1570.443443] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.443710] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.451955] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.452168] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.474375] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.474575] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a11d247-5b58-4309-be42-e273703c703a is going to be deleted. [ 1570.475544] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.475811] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.539171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.539485] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a39b75b-de15-457f-a080-b14841d7ea90 is going to be deleted. [ 1570.540337] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.540590] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.542018] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.542172] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.571713] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.571907] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 047471a8-6f49-4481-a53f-c45f9c23e798 is going to be deleted. [ 1570.572782] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.572996] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.616336] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.616524] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d is going to be deleted. [ 1570.617397] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.617607] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.638953] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.639171] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.644238] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.644479] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.679784] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.680183] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58626db2-1bef-478d-8fe6-5cb88f964fa3 is going to be deleted. [ 1570.680901] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.681126] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.682878] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.683047] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.689331] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.689513] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.726273] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.726428] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b48ccef-7f9a-4d48-8b46-294031485bbd is going to be deleted. [ 1570.727383] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.727606] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.868364] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.868584] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46b1e4e-446b-4001-9e14-1ab5b40a8087 is going to be deleted. [ 1570.869499] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.869719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.881133] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.881374] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.907028] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.907229] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.923017] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.923230] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.924081] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.924201] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ed4675f-1916-4e79-b525-fb7797e97825 is going to be deleted. [ 1570.925128] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.925338] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.981863] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.982102] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1 is going to be deleted. [ 1570.982942] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.983176] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.010998] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.011231] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.047163] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.047371] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4915dbf-d6e2-46dd-8508-11f50b8da0ef is going to be deleted. [ 1571.048234] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.048460] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.088890] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.089127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.094632] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.094794] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21980f25-eb0b-4647-8b51-f835b6f941ea is going to be deleted. [ 1571.095681] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.095898] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.095989] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.096127] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bb5a370-76e0-4d7c-9a46-84239200c704" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.096281] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.096441] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.096521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.096642] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cb67253-fbd5-4c41-8d67-3b3c6d1bc719" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.097178] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.097356] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.097423] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.097535] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5ded0ff-7d71-4a5b-8f6b-8ec8db87ec24" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.097844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.097997] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.098087] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.098203] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a251e98-2d26-4017-96a0-c67e8ea7efc0" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.098521] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.098649] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.098733] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.098850] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-612116dc-6e5d-4737-93ca-c21312262c3a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.099100] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.099247] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.099323] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.099436] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e94024-6bb7-4680-953e-a6a381af9f71" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.099559] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.099697] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.099772] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.099883] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b93b3d3-7a24-441f-88d0-38d5293ec145" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.100118] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.100259] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.100333] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.100448] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-099cf4d4-ded3-44df-b6e7-328bc3763be6" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.100602] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.100757] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.100835] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.100948] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a11d247-5b58-4309-be42-e273703c703a" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.101089] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.101227] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.101302] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.101411] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-047471a8-6f49-4481-a53f-c45f9c23e798" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.101539] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.101671] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.101740] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.101844] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a39b75b-de15-457f-a080-b14841d7ea90" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.101964] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.102115] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.102186] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.102295] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d99eaecb-f0b4-4ae5-89a2-1f7a51dc2e2d" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.102418] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.102551] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.102623] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.102722] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58626db2-1bef-478d-8fe6-5cb88f964fa3" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.102889] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.102969] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.103050] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.103160] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b48ccef-7f9a-4d48-8b46-294031485bbd" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.103286] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.103419] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.103489] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.103596] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46b1e4e-446b-4001-9e14-1ab5b40a8087" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.103716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.103846] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.103914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.104034] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ed4675f-1916-4e79-b525-fb7797e97825" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.146497] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.146716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.146716] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.146914] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.147014] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.147142] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4232a8db-cf16-41d7-9ed8-ada0ec6a2aa1" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.173317] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.173527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.173527] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.173673] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.173763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.173967] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4915dbf-d6e2-46dd-8508-11f50b8da0ef" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.218446] env[66157]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1571.218837] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.219776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.219776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.219776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.219776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.219776] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21980f25-eb0b-4647-8b51-f835b6f941ea" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.652341] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.652701] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.654266] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1579.655050] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1584.657043] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1584.657043] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1589.658567] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1589.658567] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1594.660288] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1594.660747] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1599.662114] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.662397] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1604.663242] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1604.663809] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1609.665117] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1609.665117] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1610.817694] env[66157]: INFO networking_nsxv3.common.synchronization [req-de435cf6-e431-4734-8b7f-f81c654974fa req-28929002-37cf-40f0-9eaa-af6d4099b83e tempest-AttachVolumeShelveTestJSON-1165064594 tempest-AttachVolumeShelveTestJSON-1165064594-project-member] Enqueued Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_members [ 1610.818228] env[66157]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738bf55f-e3d8-4256-b3de-164336c95608 with Priority: HIGHEST for action security_group_members [ 1610.818533] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock member-738bf55f-e3d8-4256-b3de-164336c95608 taken with stack trace [, , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.818652] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.818719] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.818930] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.819090] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.819190] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.819248] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.819972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.819972] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.819972] env[66157]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('738bf55f-e3d8-4256-b3de-164336c95608',) {} {{(pid=66157) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1611.322313] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.322554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.322554] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.322763] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.346390] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.346613] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.346744] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.346806] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.347023] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.347192] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.347339] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 is going to be updated. [ 1611.375268] env[66157]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66157) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.375503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.375503] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.375721] env[66157]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.375867] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.384474] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: IN_PROGRESS for 2s [ 1613.395962] env[66157]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738bf55f-e3d8-4256-b3de-164336c95608 in Status: SUCCESS [ 1613.396429] env[66157]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738bf55f-e3d8-4256-b3de-164336c95608 deletion is rescheduled due to dependency. [ 1613.396429] env[66157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738bf55f-e3d8-4256-b3de-164336c95608" {{(pid=66157) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.819204] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1615.819591] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1620.819770] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1620.820167] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1625.821459] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1625.821928] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1630.822689] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1630.823325] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1635.823591] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.824012] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1640.825213] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.825638] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1645.827088] env[66157]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1645.827088] env[66157]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0